2023-09-28 09:01:02,417 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-09-28 09:01:02,642 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db 2023-09-28 09:01:02,643 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-09-28 09:01:02,643 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-09-28 09:01:02,686 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-09-28 09:01:02,912 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-09-28 09:01:02,912 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/cluster_cdbda8d1-4c7c-df9a-692b-a4fb20b2dac6, deleteOnExit=true 2023-09-28 09:01:02,912 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-09-28 09:01:02,913 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/test.cache.data in system properties and HBase conf 2023-09-28 09:01:02,913 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/hadoop.tmp.dir in system properties and HBase conf 2023-09-28 09:01:02,914 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/hadoop.log.dir in system properties and HBase conf 2023-09-28 09:01:02,914 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-28 09:01:02,914 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-28 09:01:02,914 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-28 09:01:03,245 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-09-28 09:01:03,250 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-28 09:01:03,250 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-28 09:01:03,251 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-28 09:01:03,251 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-28 09:01:03,251 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-28 09:01:03,252 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-28 09:01:03,252 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-28 09:01:03,252 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-28 09:01:03,253 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-28 09:01:03,253 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/nfs.dump.dir in system properties and HBase conf 2023-09-28 09:01:03,254 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/java.io.tmpdir in system properties and HBase conf 2023-09-28 09:01:03,254 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-28 09:01:03,254 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-28 09:01:03,255 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-09-28 09:01:03,764 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-28 09:01:03,769 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-28 09:01:04,096 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-09-28 09:01:04,308 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-09-28 09:01:04,323 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-28 09:01:04,365 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-09-28 09:01:04,403 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/java.io.tmpdir/Jetty_localhost_42581_hdfs____.dlic9y/webapp 2023-09-28 09:01:04,559 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42581 2023-09-28 09:01:04,571 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-28 09:01:04,571 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-28 09:01:05,115 WARN [Listener at localhost/39781] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-28 09:01:05,202 WARN [Listener at localhost/39781] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-28 09:01:05,228 WARN [Listener at localhost/39781] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-28 09:01:05,271 INFO [Listener at localhost/39781] log.Slf4jLog(67): jetty-6.1.26 2023-09-28 09:01:05,278 INFO [Listener at localhost/39781] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/java.io.tmpdir/Jetty_localhost_44537_datanode____.q1wzb4/webapp 2023-09-28 09:01:05,394 INFO [Listener at localhost/39781] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44537 2023-09-28 09:01:05,812 WARN [Listener at localhost/46853] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-28 09:01:05,831 WARN [Listener at localhost/46853] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-28 09:01:05,837 WARN [Listener at localhost/46853] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-28 09:01:05,839 INFO [Listener at localhost/46853] log.Slf4jLog(67): jetty-6.1.26 2023-09-28 09:01:05,850 INFO [Listener at localhost/46853] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/java.io.tmpdir/Jetty_localhost_42675_datanode____.7z237n/webapp 2023-09-28 09:01:05,982 INFO [Listener at localhost/46853] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42675 2023-09-28 09:01:05,996 WARN [Listener at localhost/38929] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-28 09:01:06,012 WARN [Listener at localhost/38929] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-28 09:01:06,021 WARN [Listener at localhost/38929] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-28 09:01:06,022 INFO [Listener at localhost/38929] log.Slf4jLog(67): jetty-6.1.26 2023-09-28 09:01:06,029 INFO [Listener at localhost/38929] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/java.io.tmpdir/Jetty_localhost_38439_datanode____p7tkl8/webapp 2023-09-28 09:01:06,151 INFO [Listener at localhost/38929] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38439 2023-09-28 09:01:06,162 WARN [Listener at localhost/34939] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-28 09:01:06,395 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1ae8243d629bb37f: Processing first storage report for DS-558de0fb-deaa-4d61-a449-cd482f25d98f from datanode 3a604e24-442d-4d02-a9ee-700283cd500a 2023-09-28 09:01:06,396 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1ae8243d629bb37f: from storage DS-558de0fb-deaa-4d61-a449-cd482f25d98f node DatanodeRegistration(127.0.0.1:33597, datanodeUuid=3a604e24-442d-4d02-a9ee-700283cd500a, infoPort=41191, infoSecurePort=0, ipcPort=46853, storageInfo=lv=-57;cid=testClusterID;nsid=1374038644;c=1695891663860), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-09-28 09:01:06,397 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x82264a6b48ba96eb: Processing first storage report for DS-539620dc-4c95-4d86-b407-c1924b9b73f0 from datanode 0d41f323-2d3f-44f7-ade8-9bb601c52e9b 2023-09-28 09:01:06,397 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x82264a6b48ba96eb: from storage DS-539620dc-4c95-4d86-b407-c1924b9b73f0 node DatanodeRegistration(127.0.0.1:45549, datanodeUuid=0d41f323-2d3f-44f7-ade8-9bb601c52e9b, infoPort=45887, infoSecurePort=0, ipcPort=38929, storageInfo=lv=-57;cid=testClusterID;nsid=1374038644;c=1695891663860), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-28 09:01:06,397 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3ae95b888c94ce54: Processing first storage report for DS-b60dab29-05d9-44b9-8dad-05ac4abb9021 from datanode 3dc0a062-a92e-4f48-872a-9e1d8a22ee36 2023-09-28 09:01:06,397 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3ae95b888c94ce54: from storage DS-b60dab29-05d9-44b9-8dad-05ac4abb9021 node DatanodeRegistration(127.0.0.1:45757, datanodeUuid=3dc0a062-a92e-4f48-872a-9e1d8a22ee36, infoPort=43921, infoSecurePort=0, ipcPort=34939, storageInfo=lv=-57;cid=testClusterID;nsid=1374038644;c=1695891663860), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-28 09:01:06,397 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1ae8243d629bb37f: Processing first storage report for DS-d2a5d924-f358-4f4d-90f9-c1182f292440 from datanode 3a604e24-442d-4d02-a9ee-700283cd500a 2023-09-28 09:01:06,397 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1ae8243d629bb37f: from storage DS-d2a5d924-f358-4f4d-90f9-c1182f292440 node DatanodeRegistration(127.0.0.1:33597, datanodeUuid=3a604e24-442d-4d02-a9ee-700283cd500a, infoPort=41191, infoSecurePort=0, ipcPort=46853, storageInfo=lv=-57;cid=testClusterID;nsid=1374038644;c=1695891663860), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-09-28 09:01:06,397 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x82264a6b48ba96eb: Processing first storage report for DS-b7d690b4-3ac4-42df-8395-0258437925ee from datanode 0d41f323-2d3f-44f7-ade8-9bb601c52e9b 2023-09-28 09:01:06,397 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x82264a6b48ba96eb: from storage DS-b7d690b4-3ac4-42df-8395-0258437925ee node DatanodeRegistration(127.0.0.1:45549, datanodeUuid=0d41f323-2d3f-44f7-ade8-9bb601c52e9b, infoPort=45887, infoSecurePort=0, ipcPort=38929, storageInfo=lv=-57;cid=testClusterID;nsid=1374038644;c=1695891663860), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-28 09:01:06,398 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3ae95b888c94ce54: Processing first storage report for DS-3f5c7765-309a-42e2-b5d2-9076ce9369da from datanode 3dc0a062-a92e-4f48-872a-9e1d8a22ee36 2023-09-28 09:01:06,398 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3ae95b888c94ce54: from storage DS-3f5c7765-309a-42e2-b5d2-9076ce9369da node DatanodeRegistration(127.0.0.1:45757, datanodeUuid=3dc0a062-a92e-4f48-872a-9e1d8a22ee36, infoPort=43921, infoSecurePort=0, ipcPort=34939, storageInfo=lv=-57;cid=testClusterID;nsid=1374038644;c=1695891663860), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-28 09:01:06,650 DEBUG [Listener at localhost/34939] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db 2023-09-28 09:01:06,748 INFO [Listener at localhost/34939] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/cluster_cdbda8d1-4c7c-df9a-692b-a4fb20b2dac6/zookeeper_0, clientPort=61959, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/cluster_cdbda8d1-4c7c-df9a-692b-a4fb20b2dac6/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/cluster_cdbda8d1-4c7c-df9a-692b-a4fb20b2dac6/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-09-28 09:01:06,772 INFO [Listener at localhost/34939] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=61959 2023-09-28 09:01:06,784 INFO [Listener at localhost/34939] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-28 09:01:06,787 INFO [Listener at localhost/34939] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-28 09:01:07,483 INFO [Listener at localhost/34939] util.FSUtils(471): Created version file at hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba with version=8 2023-09-28 09:01:07,484 INFO [Listener at localhost/34939] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/hbase-staging 2023-09-28 09:01:07,848 INFO [Listener at localhost/34939] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-09-28 09:01:08,340 INFO [Listener at localhost/34939] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-09-28 09:01:08,373 INFO [Listener at localhost/34939] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-28 09:01:08,373 INFO [Listener at localhost/34939] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-28 09:01:08,374 INFO [Listener at localhost/34939] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-28 09:01:08,374 INFO [Listener at localhost/34939] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-28 09:01:08,374 INFO [Listener at localhost/34939] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-28 09:01:08,515 INFO [Listener at localhost/34939] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-09-28 09:01:08,589 DEBUG [Listener at localhost/34939] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-09-28 09:01:08,682 INFO [Listener at localhost/34939] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40293 2023-09-28 09:01:08,695 INFO [Listener at localhost/34939] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-28 09:01:08,697 INFO [Listener at localhost/34939] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-28 09:01:08,720 INFO [Listener at localhost/34939] zookeeper.RecoverableZooKeeper(93): Process identifier=master:40293 connecting to ZooKeeper ensemble=127.0.0.1:61959 2023-09-28 09:01:08,773 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:402930x0, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-28 09:01:08,776 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:40293-0x100f1c46ecd0000 connected 2023-09-28 09:01:08,809 DEBUG [Listener at localhost/34939] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-28 09:01:08,810 DEBUG [Listener at localhost/34939] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-28 09:01:08,823 DEBUG [Listener at localhost/34939] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-28 09:01:08,831 DEBUG [Listener at localhost/34939] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40293 2023-09-28 09:01:08,832 DEBUG [Listener at localhost/34939] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40293 2023-09-28 09:01:08,832 DEBUG [Listener at localhost/34939] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40293 2023-09-28 09:01:08,833 DEBUG [Listener at localhost/34939] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40293 2023-09-28 09:01:08,833 DEBUG [Listener at localhost/34939] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40293 2023-09-28 09:01:08,842 INFO [Listener at localhost/34939] master.HMaster(444): hbase.rootdir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba, hbase.cluster.distributed=false 2023-09-28 09:01:08,911 INFO [Listener at localhost/34939] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-28 09:01:08,911 INFO [Listener at localhost/34939] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-28 09:01:08,911 INFO [Listener at localhost/34939] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-28 09:01:08,911 INFO [Listener at localhost/34939] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-28 09:01:08,911 INFO [Listener at localhost/34939] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-28 09:01:08,912 INFO [Listener at localhost/34939] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-28 09:01:08,916 INFO [Listener at localhost/34939] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-28 09:01:08,919 INFO [Listener at localhost/34939] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39195 2023-09-28 09:01:08,922 INFO [Listener at localhost/34939] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-28 09:01:08,928 INFO [Listener at localhost/34939] mob.MobFileCache(125): MobFileCache disabled 2023-09-28 09:01:08,929 INFO [Listener at localhost/34939] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-28 09:01:08,931 INFO [Listener at localhost/34939] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-28 09:01:08,934 INFO [Listener at localhost/34939] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39195 connecting to ZooKeeper ensemble=127.0.0.1:61959 2023-09-28 09:01:08,939 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:391950x0, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-28 09:01:08,940 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39195-0x100f1c46ecd0001 connected 2023-09-28 09:01:08,940 DEBUG [Listener at localhost/34939] zookeeper.ZKUtil(164): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-28 09:01:08,941 DEBUG [Listener at localhost/34939] zookeeper.ZKUtil(164): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-28 09:01:08,942 DEBUG [Listener at localhost/34939] zookeeper.ZKUtil(164): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-28 09:01:08,943 DEBUG [Listener at localhost/34939] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39195 2023-09-28 09:01:08,943 DEBUG [Listener at localhost/34939] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39195 2023-09-28 09:01:08,944 DEBUG [Listener at localhost/34939] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39195 2023-09-28 09:01:08,944 DEBUG [Listener at localhost/34939] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39195 2023-09-28 09:01:08,944 DEBUG [Listener at localhost/34939] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39195 2023-09-28 09:01:08,959 INFO [Listener at localhost/34939] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-28 09:01:08,960 INFO [Listener at localhost/34939] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-28 09:01:08,960 INFO [Listener at localhost/34939] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-28 09:01:08,960 INFO [Listener at localhost/34939] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-28 09:01:08,961 INFO [Listener at localhost/34939] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-28 09:01:08,961 INFO [Listener at localhost/34939] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-28 09:01:08,961 INFO [Listener at localhost/34939] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-28 09:01:08,963 INFO [Listener at localhost/34939] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40311 2023-09-28 09:01:08,963 INFO [Listener at localhost/34939] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-28 09:01:08,967 INFO [Listener at localhost/34939] mob.MobFileCache(125): MobFileCache disabled 2023-09-28 09:01:08,968 INFO [Listener at localhost/34939] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-28 09:01:08,971 INFO [Listener at localhost/34939] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-28 09:01:08,974 INFO [Listener at localhost/34939] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40311 connecting to ZooKeeper ensemble=127.0.0.1:61959 2023-09-28 09:01:08,978 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:403110x0, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-28 09:01:08,980 DEBUG [Listener at localhost/34939] zookeeper.ZKUtil(164): regionserver:403110x0, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-28 09:01:08,980 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:40311-0x100f1c46ecd0002 connected 2023-09-28 09:01:08,981 DEBUG [Listener at localhost/34939] zookeeper.ZKUtil(164): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-28 09:01:08,982 DEBUG [Listener at localhost/34939] zookeeper.ZKUtil(164): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-28 09:01:08,985 DEBUG [Listener at localhost/34939] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40311 2023-09-28 09:01:08,985 DEBUG [Listener at localhost/34939] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40311 2023-09-28 09:01:08,985 DEBUG [Listener at localhost/34939] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40311 2023-09-28 09:01:08,988 DEBUG [Listener at localhost/34939] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40311 2023-09-28 09:01:08,989 DEBUG [Listener at localhost/34939] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40311 2023-09-28 09:01:09,001 INFO [Listener at localhost/34939] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-28 09:01:09,001 INFO [Listener at localhost/34939] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-28 09:01:09,001 INFO [Listener at localhost/34939] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-28 09:01:09,001 INFO [Listener at localhost/34939] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-28 09:01:09,002 INFO [Listener at localhost/34939] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-28 09:01:09,002 INFO [Listener at localhost/34939] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-28 09:01:09,002 INFO [Listener at localhost/34939] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-28 09:01:09,003 INFO [Listener at localhost/34939] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40045 2023-09-28 09:01:09,004 INFO [Listener at localhost/34939] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-28 09:01:09,004 INFO [Listener at localhost/34939] mob.MobFileCache(125): MobFileCache disabled 2023-09-28 09:01:09,006 INFO [Listener at localhost/34939] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-28 09:01:09,007 INFO [Listener at localhost/34939] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-28 09:01:09,009 INFO [Listener at localhost/34939] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40045 connecting to ZooKeeper ensemble=127.0.0.1:61959 2023-09-28 09:01:09,013 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:400450x0, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-28 09:01:09,014 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:40045-0x100f1c46ecd0003 connected 2023-09-28 09:01:09,014 DEBUG [Listener at localhost/34939] zookeeper.ZKUtil(164): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-28 09:01:09,015 DEBUG [Listener at localhost/34939] zookeeper.ZKUtil(164): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-28 09:01:09,016 DEBUG [Listener at localhost/34939] zookeeper.ZKUtil(164): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-28 09:01:09,017 DEBUG [Listener at localhost/34939] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40045 2023-09-28 09:01:09,017 DEBUG [Listener at localhost/34939] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40045 2023-09-28 09:01:09,017 DEBUG [Listener at localhost/34939] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40045 2023-09-28 09:01:09,021 DEBUG [Listener at localhost/34939] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40045 2023-09-28 09:01:09,025 DEBUG [Listener at localhost/34939] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40045 2023-09-28 09:01:09,026 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,40293,1695891667656 2023-09-28 09:01:09,036 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-28 09:01:09,037 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,40293,1695891667656 2023-09-28 09:01:09,059 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-28 09:01:09,059 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-28 09:01:09,059 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-28 09:01:09,059 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-28 09:01:09,059 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-28 09:01:09,062 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-28 09:01:09,063 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,40293,1695891667656 from backup master directory 2023-09-28 09:01:09,063 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-28 09:01:09,068 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,40293,1695891667656 2023-09-28 09:01:09,068 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-28 09:01:09,069 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-28 09:01:09,069 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,40293,1695891667656 2023-09-28 09:01:09,072 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-09-28 09:01:09,075 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-09-28 09:01:09,172 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/hbase.id with ID: 8c5720e6-af63-494c-9205-164902a88dce 2023-09-28 09:01:09,212 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-28 09:01:09,231 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-28 09:01:09,285 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x1ce94ec2 to 127.0.0.1:61959 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 09:01:09,319 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@25356edf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 09:01:09,351 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-28 09:01:09,353 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-09-28 09:01:09,371 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-09-28 09:01:09,371 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-09-28 09:01:09,373 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-28 09:01:09,377 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-28 09:01:09,379 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-28 09:01:09,415 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/MasterData/data/master/store-tmp 2023-09-28 09:01:09,451 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 09:01:09,451 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-28 09:01:09,451 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-28 09:01:09,451 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-28 09:01:09,452 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-28 09:01:09,452 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-28 09:01:09,452 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-28 09:01:09,452 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-28 09:01:09,454 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/MasterData/WALs/jenkins-hbase4.apache.org,40293,1695891667656 2023-09-28 09:01:09,476 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40293%2C1695891667656, suffix=, logDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/MasterData/WALs/jenkins-hbase4.apache.org,40293,1695891667656, archiveDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/MasterData/oldWALs, maxLogs=10 2023-09-28 09:01:09,533 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45549,DS-539620dc-4c95-4d86-b407-c1924b9b73f0,DISK] 2023-09-28 09:01:09,533 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33597,DS-558de0fb-deaa-4d61-a449-cd482f25d98f,DISK] 2023-09-28 09:01:09,533 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45757,DS-b60dab29-05d9-44b9-8dad-05ac4abb9021,DISK] 2023-09-28 09:01:09,543 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-09-28 09:01:09,614 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/MasterData/WALs/jenkins-hbase4.apache.org,40293,1695891667656/jenkins-hbase4.apache.org%2C40293%2C1695891667656.1695891669487 2023-09-28 09:01:09,615 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45549,DS-539620dc-4c95-4d86-b407-c1924b9b73f0,DISK], DatanodeInfoWithStorage[127.0.0.1:33597,DS-558de0fb-deaa-4d61-a449-cd482f25d98f,DISK], DatanodeInfoWithStorage[127.0.0.1:45757,DS-b60dab29-05d9-44b9-8dad-05ac4abb9021,DISK]] 2023-09-28 09:01:09,616 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-09-28 09:01:09,616 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 09:01:09,619 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-09-28 09:01:09,620 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-09-28 09:01:09,683 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-09-28 09:01:09,690 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-09-28 09:01:09,725 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-09-28 09:01:09,739 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 09:01:09,746 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-28 09:01:09,748 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-28 09:01:09,767 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-09-28 09:01:09,773 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 09:01:09,774 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69847709, jitterRate=0.040811970829963684}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 09:01:09,774 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-28 09:01:09,776 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-09-28 09:01:09,809 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-09-28 09:01:09,809 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-09-28 09:01:09,812 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-09-28 09:01:09,814 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-09-28 09:01:09,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 36 msec 2023-09-28 09:01:09,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-09-28 09:01:09,882 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-09-28 09:01:09,888 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-09-28 09:01:09,913 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-09-28 09:01:09,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-09-28 09:01:09,919 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-09-28 09:01:09,925 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-09-28 09:01:09,930 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-09-28 09:01:09,932 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-28 09:01:09,934 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-09-28 09:01:09,935 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-09-28 09:01:09,949 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-09-28 09:01:09,953 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-28 09:01:09,954 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-28 09:01:09,954 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-28 09:01:09,954 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-28 09:01:09,954 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-28 09:01:09,955 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,40293,1695891667656, sessionid=0x100f1c46ecd0000, setting cluster-up flag (Was=false) 2023-09-28 09:01:09,977 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-28 09:01:09,984 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-09-28 09:01:09,986 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40293,1695891667656 2023-09-28 09:01:09,992 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-28 09:01:09,999 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-09-28 09:01:10,000 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40293,1695891667656 2023-09-28 09:01:10,003 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/.tmp 2023-09-28 09:01:10,029 INFO [RS:2;jenkins-hbase4:40045] regionserver.HRegionServer(951): ClusterId : 8c5720e6-af63-494c-9205-164902a88dce 2023-09-28 09:01:10,029 INFO [RS:1;jenkins-hbase4:40311] regionserver.HRegionServer(951): ClusterId : 8c5720e6-af63-494c-9205-164902a88dce 2023-09-28 09:01:10,029 INFO [RS:0;jenkins-hbase4:39195] regionserver.HRegionServer(951): ClusterId : 8c5720e6-af63-494c-9205-164902a88dce 2023-09-28 09:01:10,037 DEBUG [RS:1;jenkins-hbase4:40311] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-28 09:01:10,037 DEBUG [RS:0;jenkins-hbase4:39195] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-28 09:01:10,037 DEBUG [RS:2;jenkins-hbase4:40045] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-28 09:01:10,044 DEBUG [RS:2;jenkins-hbase4:40045] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-28 09:01:10,044 DEBUG [RS:0;jenkins-hbase4:39195] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-28 09:01:10,044 DEBUG [RS:1;jenkins-hbase4:40311] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-28 09:01:10,044 DEBUG [RS:0;jenkins-hbase4:39195] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-28 09:01:10,044 DEBUG [RS:2;jenkins-hbase4:40045] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-28 09:01:10,044 DEBUG [RS:1;jenkins-hbase4:40311] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-28 09:01:10,049 DEBUG [RS:2;jenkins-hbase4:40045] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-28 09:01:10,049 DEBUG [RS:1;jenkins-hbase4:40311] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-28 09:01:10,049 DEBUG [RS:0;jenkins-hbase4:39195] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-28 09:01:10,056 DEBUG [RS:2;jenkins-hbase4:40045] zookeeper.ReadOnlyZKClient(139): Connect 0x2c233932 to 127.0.0.1:61959 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 09:01:10,057 DEBUG [RS:0;jenkins-hbase4:39195] zookeeper.ReadOnlyZKClient(139): Connect 0x1a0467bd to 127.0.0.1:61959 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 09:01:10,057 DEBUG [RS:1;jenkins-hbase4:40311] zookeeper.ReadOnlyZKClient(139): Connect 0x1a903caf to 127.0.0.1:61959 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 09:01:10,068 DEBUG [RS:1;jenkins-hbase4:40311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1457c18d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 09:01:10,068 DEBUG [RS:2;jenkins-hbase4:40045] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22e4c2c6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 09:01:10,069 DEBUG [RS:1;jenkins-hbase4:40311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@106857df, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-28 09:01:10,069 DEBUG [RS:2;jenkins-hbase4:40045] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@26db5242, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-28 09:01:10,069 DEBUG [RS:0;jenkins-hbase4:39195] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@14c39a8d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 09:01:10,069 DEBUG [RS:0;jenkins-hbase4:39195] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10fc0ccd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-28 09:01:10,100 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-09-28 09:01:10,103 DEBUG [RS:2;jenkins-hbase4:40045] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:40045 2023-09-28 09:01:10,103 DEBUG [RS:1;jenkins-hbase4:40311] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:40311 2023-09-28 09:01:10,104 DEBUG [RS:0;jenkins-hbase4:39195] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:39195 2023-09-28 09:01:10,106 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 09:01:10,106 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-09-28 09:01:10,110 INFO [RS:0;jenkins-hbase4:39195] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-28 09:01:10,110 INFO [RS:2;jenkins-hbase4:40045] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-28 09:01:10,111 INFO [RS:2;jenkins-hbase4:40045] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-28 09:01:10,110 INFO [RS:1;jenkins-hbase4:40311] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-28 09:01:10,111 INFO [RS:0;jenkins-hbase4:39195] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-28 09:01:10,111 INFO [RS:1;jenkins-hbase4:40311] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-28 09:01:10,111 DEBUG [RS:0;jenkins-hbase4:39195] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-28 09:01:10,111 DEBUG [RS:1;jenkins-hbase4:40311] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-28 09:01:10,111 DEBUG [RS:2;jenkins-hbase4:40045] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-28 09:01:10,112 INFO [RS:0;jenkins-hbase4:39195] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 09:01:10,112 INFO [RS:1;jenkins-hbase4:40311] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 09:01:10,113 DEBUG [RS:1;jenkins-hbase4:40311] regionserver.HRegionServer(1022): About to register with Master. 2023-09-28 09:01:10,112 DEBUG [RS:0;jenkins-hbase4:39195] regionserver.HRegionServer(1022): About to register with Master. 2023-09-28 09:01:10,112 INFO [RS:2;jenkins-hbase4:40045] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 09:01:10,113 DEBUG [RS:2;jenkins-hbase4:40045] regionserver.HRegionServer(1022): About to register with Master. 2023-09-28 09:01:10,116 INFO [RS:0;jenkins-hbase4:39195] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40293,1695891667656 with isa=jenkins-hbase4.apache.org/172.31.14.131:39195, startcode=1695891668910 2023-09-28 09:01:10,116 INFO [RS:2;jenkins-hbase4:40045] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40293,1695891667656 with isa=jenkins-hbase4.apache.org/172.31.14.131:40045, startcode=1695891669000 2023-09-28 09:01:10,116 INFO [RS:1;jenkins-hbase4:40311] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40293,1695891667656 with isa=jenkins-hbase4.apache.org/172.31.14.131:40311, startcode=1695891668959 2023-09-28 09:01:10,138 DEBUG [RS:2;jenkins-hbase4:40045] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-28 09:01:10,138 DEBUG [RS:0;jenkins-hbase4:39195] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-28 09:01:10,138 DEBUG [RS:1;jenkins-hbase4:40311] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-28 09:01:10,215 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-09-28 09:01:10,216 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59563, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-09-28 09:01:10,216 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39377, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-09-28 09:01:10,216 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45947, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-09-28 09:01:10,226 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40293] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-28 09:01:10,228 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-28 09:01:10,228 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-28 09:01:10,228 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-28 09:01:10,228 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-28 09:01:10,229 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-09-28 09:01:10,229 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 09:01:10,229 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-28 09:01:10,229 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 09:01:10,232 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1695891700232 2023-09-28 09:01:10,234 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-09-28 09:01:10,238 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40293] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-28 09:01:10,244 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40293] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-28 09:01:10,251 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-09-28 09:01:10,251 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-09-28 09:01:10,252 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-09-28 09:01:10,258 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-09-28 09:01:10,258 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-28 09:01:10,258 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-09-28 09:01:10,259 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-09-28 09:01:10,259 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-09-28 09:01:10,260 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-28 09:01:10,261 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-09-28 09:01:10,263 DEBUG [RS:1;jenkins-hbase4:40311] regionserver.HRegionServer(2830): Master is not running yet 2023-09-28 09:01:10,264 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-09-28 09:01:10,265 WARN [RS:1;jenkins-hbase4:40311] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-28 09:01:10,263 DEBUG [RS:2;jenkins-hbase4:40045] regionserver.HRegionServer(2830): Master is not running yet 2023-09-28 09:01:10,265 WARN [RS:2;jenkins-hbase4:40045] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-28 09:01:10,263 DEBUG [RS:0;jenkins-hbase4:39195] regionserver.HRegionServer(2830): Master is not running yet 2023-09-28 09:01:10,265 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-09-28 09:01:10,265 WARN [RS:0;jenkins-hbase4:39195] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-28 09:01:10,269 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-09-28 09:01:10,270 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-09-28 09:01:10,272 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695891670272,5,FailOnTimeoutGroup] 2023-09-28 09:01:10,273 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695891670272,5,FailOnTimeoutGroup] 2023-09-28 09:01:10,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-28 09:01:10,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-09-28 09:01:10,275 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-09-28 09:01:10,275 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-09-28 09:01:10,308 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-28 09:01:10,309 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-28 09:01:10,309 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba 2023-09-28 09:01:10,336 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 09:01:10,339 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-28 09:01:10,341 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/hbase/meta/1588230740/info 2023-09-28 09:01:10,342 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-28 09:01:10,343 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 09:01:10,343 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-28 09:01:10,346 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/hbase/meta/1588230740/rep_barrier 2023-09-28 09:01:10,346 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-28 09:01:10,347 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 09:01:10,347 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-28 09:01:10,349 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/hbase/meta/1588230740/table 2023-09-28 09:01:10,350 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-28 09:01:10,351 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 09:01:10,352 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/hbase/meta/1588230740 2023-09-28 09:01:10,353 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/hbase/meta/1588230740 2023-09-28 09:01:10,357 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-28 09:01:10,359 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-28 09:01:10,363 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 09:01:10,363 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72463164, jitterRate=0.0797852873802185}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-28 09:01:10,363 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-28 09:01:10,364 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-28 09:01:10,364 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-28 09:01:10,364 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-28 09:01:10,364 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-28 09:01:10,364 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-28 09:01:10,366 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-28 09:01:10,366 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-28 09:01:10,369 INFO [RS:1;jenkins-hbase4:40311] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40293,1695891667656 with isa=jenkins-hbase4.apache.org/172.31.14.131:40311, startcode=1695891668959 2023-09-28 09:01:10,372 INFO [RS:2;jenkins-hbase4:40045] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40293,1695891667656 with isa=jenkins-hbase4.apache.org/172.31.14.131:40045, startcode=1695891669000 2023-09-28 09:01:10,373 INFO [RS:0;jenkins-hbase4:39195] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40293,1695891667656 with isa=jenkins-hbase4.apache.org/172.31.14.131:39195, startcode=1695891668910 2023-09-28 09:01:10,376 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40293] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:10,377 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-09-28 09:01:10,377 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-09-28 09:01:10,384 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40293] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:10,385 DEBUG [RS:1;jenkins-hbase4:40311] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba 2023-09-28 09:01:10,385 DEBUG [RS:1;jenkins-hbase4:40311] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:39781 2023-09-28 09:01:10,385 DEBUG [RS:1;jenkins-hbase4:40311] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-28 09:01:10,386 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40293] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:10,386 DEBUG [RS:0;jenkins-hbase4:39195] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba 2023-09-28 09:01:10,386 DEBUG [RS:0;jenkins-hbase4:39195] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:39781 2023-09-28 09:01:10,387 DEBUG [RS:0;jenkins-hbase4:39195] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-28 09:01:10,388 DEBUG [RS:2;jenkins-hbase4:40045] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba 2023-09-28 09:01:10,388 DEBUG [RS:2;jenkins-hbase4:40045] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:39781 2023-09-28 09:01:10,388 DEBUG [RS:2;jenkins-hbase4:40045] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-28 09:01:10,391 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-09-28 09:01:10,393 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-28 09:01:10,403 DEBUG [RS:0;jenkins-hbase4:39195] zookeeper.ZKUtil(162): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:10,403 WARN [RS:0;jenkins-hbase4:39195] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-28 09:01:10,404 INFO [RS:0;jenkins-hbase4:39195] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-28 09:01:10,404 DEBUG [RS:2;jenkins-hbase4:40045] zookeeper.ZKUtil(162): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:10,404 DEBUG [RS:0;jenkins-hbase4:39195] regionserver.HRegionServer(1948): logDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/WALs/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:10,404 DEBUG [RS:1;jenkins-hbase4:40311] zookeeper.ZKUtil(162): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:10,405 WARN [RS:1;jenkins-hbase4:40311] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-28 09:01:10,404 WARN [RS:2;jenkins-hbase4:40045] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-28 09:01:10,405 INFO [RS:2;jenkins-hbase4:40045] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-28 09:01:10,406 DEBUG [RS:2;jenkins-hbase4:40045] regionserver.HRegionServer(1948): logDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/WALs/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:10,405 INFO [RS:1;jenkins-hbase4:40311] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-28 09:01:10,407 DEBUG [RS:1;jenkins-hbase4:40311] regionserver.HRegionServer(1948): logDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/WALs/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:10,406 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40045,1695891669000] 2023-09-28 09:01:10,408 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39195,1695891668910] 2023-09-28 09:01:10,408 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40311,1695891668959] 2023-09-28 09:01:10,410 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-09-28 09:01:10,416 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-09-28 09:01:10,423 DEBUG [RS:1;jenkins-hbase4:40311] zookeeper.ZKUtil(162): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:10,423 DEBUG [RS:2;jenkins-hbase4:40045] zookeeper.ZKUtil(162): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:10,423 DEBUG [RS:0;jenkins-hbase4:39195] zookeeper.ZKUtil(162): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:10,424 DEBUG [RS:1;jenkins-hbase4:40311] zookeeper.ZKUtil(162): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:10,424 DEBUG [RS:2;jenkins-hbase4:40045] zookeeper.ZKUtil(162): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:10,424 DEBUG [RS:0;jenkins-hbase4:39195] zookeeper.ZKUtil(162): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:10,424 DEBUG [RS:2;jenkins-hbase4:40045] zookeeper.ZKUtil(162): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:10,424 DEBUG [RS:0;jenkins-hbase4:39195] zookeeper.ZKUtil(162): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:10,424 DEBUG [RS:1;jenkins-hbase4:40311] zookeeper.ZKUtil(162): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:10,438 DEBUG [RS:1;jenkins-hbase4:40311] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-28 09:01:10,438 DEBUG [RS:2;jenkins-hbase4:40045] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-28 09:01:10,438 DEBUG [RS:0;jenkins-hbase4:39195] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-28 09:01:10,450 INFO [RS:0;jenkins-hbase4:39195] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-28 09:01:10,450 INFO [RS:1;jenkins-hbase4:40311] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-28 09:01:10,450 INFO [RS:2;jenkins-hbase4:40045] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-28 09:01:10,475 INFO [RS:2;jenkins-hbase4:40045] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-28 09:01:10,476 INFO [RS:1;jenkins-hbase4:40311] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-28 09:01:10,477 INFO [RS:0;jenkins-hbase4:39195] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-28 09:01:10,480 INFO [RS:2;jenkins-hbase4:40045] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-28 09:01:10,480 INFO [RS:1;jenkins-hbase4:40311] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-28 09:01:10,480 INFO [RS:0;jenkins-hbase4:39195] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-28 09:01:10,481 INFO [RS:1;jenkins-hbase4:40311] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-28 09:01:10,481 INFO [RS:2;jenkins-hbase4:40045] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-28 09:01:10,481 INFO [RS:0;jenkins-hbase4:39195] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-28 09:01:10,483 INFO [RS:0;jenkins-hbase4:39195] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-28 09:01:10,483 INFO [RS:2;jenkins-hbase4:40045] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-28 09:01:10,483 INFO [RS:1;jenkins-hbase4:40311] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-28 09:01:10,491 INFO [RS:0;jenkins-hbase4:39195] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-28 09:01:10,491 INFO [RS:1;jenkins-hbase4:40311] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-28 09:01:10,491 INFO [RS:2;jenkins-hbase4:40045] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-28 09:01:10,491 DEBUG [RS:0;jenkins-hbase4:39195] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 09:01:10,492 DEBUG [RS:1;jenkins-hbase4:40311] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 09:01:10,492 DEBUG [RS:0;jenkins-hbase4:39195] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 09:01:10,492 DEBUG [RS:1;jenkins-hbase4:40311] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 09:01:10,492 DEBUG [RS:2;jenkins-hbase4:40045] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 09:01:10,492 DEBUG [RS:1;jenkins-hbase4:40311] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 09:01:10,492 DEBUG [RS:2;jenkins-hbase4:40045] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 09:01:10,492 DEBUG [RS:1;jenkins-hbase4:40311] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 09:01:10,492 DEBUG [RS:2;jenkins-hbase4:40045] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 09:01:10,492 DEBUG [RS:1;jenkins-hbase4:40311] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 09:01:10,493 DEBUG [RS:2;jenkins-hbase4:40045] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 09:01:10,493 DEBUG [RS:1;jenkins-hbase4:40311] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-28 09:01:10,493 DEBUG [RS:2;jenkins-hbase4:40045] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 09:01:10,493 DEBUG [RS:1;jenkins-hbase4:40311] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 09:01:10,493 DEBUG [RS:2;jenkins-hbase4:40045] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-28 09:01:10,492 DEBUG [RS:0;jenkins-hbase4:39195] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 09:01:10,493 DEBUG [RS:2;jenkins-hbase4:40045] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 09:01:10,493 DEBUG [RS:0;jenkins-hbase4:39195] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 09:01:10,493 DEBUG [RS:2;jenkins-hbase4:40045] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 09:01:10,493 DEBUG [RS:0;jenkins-hbase4:39195] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 09:01:10,493 DEBUG [RS:2;jenkins-hbase4:40045] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 09:01:10,493 DEBUG [RS:0;jenkins-hbase4:39195] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-28 09:01:10,493 DEBUG [RS:2;jenkins-hbase4:40045] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 09:01:10,493 DEBUG [RS:1;jenkins-hbase4:40311] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 09:01:10,493 DEBUG [RS:0;jenkins-hbase4:39195] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 09:01:10,494 DEBUG [RS:1;jenkins-hbase4:40311] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 09:01:10,494 DEBUG [RS:0;jenkins-hbase4:39195] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 09:01:10,494 DEBUG [RS:1;jenkins-hbase4:40311] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 09:01:10,494 DEBUG [RS:0;jenkins-hbase4:39195] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 09:01:10,494 DEBUG [RS:0;jenkins-hbase4:39195] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 09:01:10,498 INFO [RS:2;jenkins-hbase4:40045] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-28 09:01:10,498 INFO [RS:2;jenkins-hbase4:40045] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-28 09:01:10,498 INFO [RS:2;jenkins-hbase4:40045] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-28 09:01:10,499 INFO [RS:0;jenkins-hbase4:39195] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-28 09:01:10,499 INFO [RS:0;jenkins-hbase4:39195] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-28 09:01:10,499 INFO [RS:0;jenkins-hbase4:39195] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-28 09:01:10,503 INFO [RS:1;jenkins-hbase4:40311] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-28 09:01:10,503 INFO [RS:1;jenkins-hbase4:40311] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-28 09:01:10,503 INFO [RS:1;jenkins-hbase4:40311] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-28 09:01:10,518 INFO [RS:2;jenkins-hbase4:40045] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-28 09:01:10,518 INFO [RS:0;jenkins-hbase4:39195] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-28 09:01:10,519 INFO [RS:1;jenkins-hbase4:40311] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-28 09:01:10,522 INFO [RS:2;jenkins-hbase4:40045] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40045,1695891669000-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-28 09:01:10,522 INFO [RS:1;jenkins-hbase4:40311] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40311,1695891668959-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-28 09:01:10,522 INFO [RS:0;jenkins-hbase4:39195] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39195,1695891668910-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-28 09:01:10,549 INFO [RS:2;jenkins-hbase4:40045] regionserver.Replication(203): jenkins-hbase4.apache.org,40045,1695891669000 started 2023-09-28 09:01:10,549 INFO [RS:2;jenkins-hbase4:40045] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,40045,1695891669000, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40045, sessionid=0x100f1c46ecd0003 2023-09-28 09:01:10,549 DEBUG [RS:2;jenkins-hbase4:40045] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-28 09:01:10,549 DEBUG [RS:2;jenkins-hbase4:40045] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:10,549 DEBUG [RS:2;jenkins-hbase4:40045] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40045,1695891669000' 2023-09-28 09:01:10,549 DEBUG [RS:2;jenkins-hbase4:40045] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-28 09:01:10,550 DEBUG [RS:2;jenkins-hbase4:40045] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-28 09:01:10,550 INFO [RS:0;jenkins-hbase4:39195] regionserver.Replication(203): jenkins-hbase4.apache.org,39195,1695891668910 started 2023-09-28 09:01:10,551 INFO [RS:0;jenkins-hbase4:39195] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,39195,1695891668910, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39195, sessionid=0x100f1c46ecd0001 2023-09-28 09:01:10,551 DEBUG [RS:2;jenkins-hbase4:40045] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-28 09:01:10,551 DEBUG [RS:2;jenkins-hbase4:40045] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-28 09:01:10,551 DEBUG [RS:2;jenkins-hbase4:40045] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:10,551 DEBUG [RS:2;jenkins-hbase4:40045] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40045,1695891669000' 2023-09-28 09:01:10,551 DEBUG [RS:2;jenkins-hbase4:40045] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:01:10,552 DEBUG [RS:0;jenkins-hbase4:39195] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-28 09:01:10,552 INFO [RS:1;jenkins-hbase4:40311] regionserver.Replication(203): jenkins-hbase4.apache.org,40311,1695891668959 started 2023-09-28 09:01:10,552 DEBUG [RS:2;jenkins-hbase4:40045] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:01:10,552 INFO [RS:1;jenkins-hbase4:40311] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,40311,1695891668959, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40311, sessionid=0x100f1c46ecd0002 2023-09-28 09:01:10,552 DEBUG [RS:1;jenkins-hbase4:40311] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-28 09:01:10,552 DEBUG [RS:0;jenkins-hbase4:39195] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:10,553 DEBUG [RS:1;jenkins-hbase4:40311] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:10,554 DEBUG [RS:2;jenkins-hbase4:40045] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-28 09:01:10,553 DEBUG [RS:0;jenkins-hbase4:39195] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39195,1695891668910' 2023-09-28 09:01:10,554 INFO [RS:2;jenkins-hbase4:40045] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-28 09:01:10,554 DEBUG [RS:1;jenkins-hbase4:40311] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40311,1695891668959' 2023-09-28 09:01:10,554 INFO [RS:2;jenkins-hbase4:40045] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-28 09:01:10,554 DEBUG [RS:0;jenkins-hbase4:39195] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-28 09:01:10,555 DEBUG [RS:1;jenkins-hbase4:40311] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-28 09:01:10,555 DEBUG [RS:0;jenkins-hbase4:39195] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-28 09:01:10,555 DEBUG [RS:1;jenkins-hbase4:40311] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-28 09:01:10,556 DEBUG [RS:0;jenkins-hbase4:39195] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-28 09:01:10,556 DEBUG [RS:0;jenkins-hbase4:39195] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-28 09:01:10,556 DEBUG [RS:1;jenkins-hbase4:40311] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-28 09:01:10,556 DEBUG [RS:0;jenkins-hbase4:39195] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:10,556 DEBUG [RS:1;jenkins-hbase4:40311] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-28 09:01:10,556 DEBUG [RS:0;jenkins-hbase4:39195] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39195,1695891668910' 2023-09-28 09:01:10,557 DEBUG [RS:0;jenkins-hbase4:39195] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:01:10,556 DEBUG [RS:1;jenkins-hbase4:40311] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:10,557 DEBUG [RS:1;jenkins-hbase4:40311] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40311,1695891668959' 2023-09-28 09:01:10,557 DEBUG [RS:1;jenkins-hbase4:40311] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:01:10,557 DEBUG [RS:0;jenkins-hbase4:39195] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:01:10,557 DEBUG [RS:1;jenkins-hbase4:40311] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:01:10,558 DEBUG [RS:0;jenkins-hbase4:39195] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-28 09:01:10,558 INFO [RS:0;jenkins-hbase4:39195] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-28 09:01:10,558 INFO [RS:0;jenkins-hbase4:39195] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-28 09:01:10,559 DEBUG [RS:1;jenkins-hbase4:40311] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-28 09:01:10,559 INFO [RS:1;jenkins-hbase4:40311] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-28 09:01:10,559 INFO [RS:1;jenkins-hbase4:40311] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-28 09:01:10,569 DEBUG [jenkins-hbase4:40293] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-09-28 09:01:10,574 DEBUG [jenkins-hbase4:40293] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-28 09:01:10,581 DEBUG [jenkins-hbase4:40293] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-28 09:01:10,581 DEBUG [jenkins-hbase4:40293] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-28 09:01:10,581 DEBUG [jenkins-hbase4:40293] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-28 09:01:10,581 DEBUG [jenkins-hbase4:40293] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-28 09:01:10,584 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40311,1695891668959, state=OPENING 2023-09-28 09:01:10,592 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-09-28 09:01:10,594 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-28 09:01:10,595 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-28 09:01:10,598 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40311,1695891668959}] 2023-09-28 09:01:10,667 INFO [RS:2;jenkins-hbase4:40045] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40045%2C1695891669000, suffix=, logDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/WALs/jenkins-hbase4.apache.org,40045,1695891669000, archiveDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/oldWALs, maxLogs=32 2023-09-28 09:01:10,667 INFO [RS:1;jenkins-hbase4:40311] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40311%2C1695891668959, suffix=, logDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/WALs/jenkins-hbase4.apache.org,40311,1695891668959, archiveDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/oldWALs, maxLogs=32 2023-09-28 09:01:10,668 INFO [RS:0;jenkins-hbase4:39195] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39195%2C1695891668910, suffix=, logDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/WALs/jenkins-hbase4.apache.org,39195,1695891668910, archiveDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/oldWALs, maxLogs=32 2023-09-28 09:01:10,710 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33597,DS-558de0fb-deaa-4d61-a449-cd482f25d98f,DISK] 2023-09-28 09:01:10,710 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33597,DS-558de0fb-deaa-4d61-a449-cd482f25d98f,DISK] 2023-09-28 09:01:10,710 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45549,DS-539620dc-4c95-4d86-b407-c1924b9b73f0,DISK] 2023-09-28 09:01:10,711 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45757,DS-b60dab29-05d9-44b9-8dad-05ac4abb9021,DISK] 2023-09-28 09:01:10,726 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45757,DS-b60dab29-05d9-44b9-8dad-05ac4abb9021,DISK] 2023-09-28 09:01:10,729 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45549,DS-539620dc-4c95-4d86-b407-c1924b9b73f0,DISK] 2023-09-28 09:01:10,730 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33597,DS-558de0fb-deaa-4d61-a449-cd482f25d98f,DISK] 2023-09-28 09:01:10,731 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45757,DS-b60dab29-05d9-44b9-8dad-05ac4abb9021,DISK] 2023-09-28 09:01:10,731 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45549,DS-539620dc-4c95-4d86-b407-c1924b9b73f0,DISK] 2023-09-28 09:01:10,743 INFO [RS:1;jenkins-hbase4:40311] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/WALs/jenkins-hbase4.apache.org,40311,1695891668959/jenkins-hbase4.apache.org%2C40311%2C1695891668959.1695891670673 2023-09-28 09:01:10,745 DEBUG [RS:1;jenkins-hbase4:40311] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45757,DS-b60dab29-05d9-44b9-8dad-05ac4abb9021,DISK], DatanodeInfoWithStorage[127.0.0.1:33597,DS-558de0fb-deaa-4d61-a449-cd482f25d98f,DISK], DatanodeInfoWithStorage[127.0.0.1:45549,DS-539620dc-4c95-4d86-b407-c1924b9b73f0,DISK]] 2023-09-28 09:01:10,746 INFO [RS:2;jenkins-hbase4:40045] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/WALs/jenkins-hbase4.apache.org,40045,1695891669000/jenkins-hbase4.apache.org%2C40045%2C1695891669000.1695891670673 2023-09-28 09:01:10,747 DEBUG [RS:2;jenkins-hbase4:40045] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45757,DS-b60dab29-05d9-44b9-8dad-05ac4abb9021,DISK], DatanodeInfoWithStorage[127.0.0.1:33597,DS-558de0fb-deaa-4d61-a449-cd482f25d98f,DISK], DatanodeInfoWithStorage[127.0.0.1:45549,DS-539620dc-4c95-4d86-b407-c1924b9b73f0,DISK]] 2023-09-28 09:01:10,747 INFO [RS:0;jenkins-hbase4:39195] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/WALs/jenkins-hbase4.apache.org,39195,1695891668910/jenkins-hbase4.apache.org%2C39195%2C1695891668910.1695891670673 2023-09-28 09:01:10,749 DEBUG [RS:0;jenkins-hbase4:39195] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45549,DS-539620dc-4c95-4d86-b407-c1924b9b73f0,DISK], DatanodeInfoWithStorage[127.0.0.1:33597,DS-558de0fb-deaa-4d61-a449-cd482f25d98f,DISK], DatanodeInfoWithStorage[127.0.0.1:45757,DS-b60dab29-05d9-44b9-8dad-05ac4abb9021,DISK]] 2023-09-28 09:01:10,786 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:10,788 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-28 09:01:10,791 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39740, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-28 09:01:10,803 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-09-28 09:01:10,803 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-28 09:01:10,807 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40311%2C1695891668959.meta, suffix=.meta, logDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/WALs/jenkins-hbase4.apache.org,40311,1695891668959, archiveDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/oldWALs, maxLogs=32 2023-09-28 09:01:10,826 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45549,DS-539620dc-4c95-4d86-b407-c1924b9b73f0,DISK] 2023-09-28 09:01:10,827 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33597,DS-558de0fb-deaa-4d61-a449-cd482f25d98f,DISK] 2023-09-28 09:01:10,831 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45757,DS-b60dab29-05d9-44b9-8dad-05ac4abb9021,DISK] 2023-09-28 09:01:10,836 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/WALs/jenkins-hbase4.apache.org,40311,1695891668959/jenkins-hbase4.apache.org%2C40311%2C1695891668959.meta.1695891670808.meta 2023-09-28 09:01:10,837 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45549,DS-539620dc-4c95-4d86-b407-c1924b9b73f0,DISK], DatanodeInfoWithStorage[127.0.0.1:33597,DS-558de0fb-deaa-4d61-a449-cd482f25d98f,DISK], DatanodeInfoWithStorage[127.0.0.1:45757,DS-b60dab29-05d9-44b9-8dad-05ac4abb9021,DISK]] 2023-09-28 09:01:10,837 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-09-28 09:01:10,838 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-09-28 09:01:10,839 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 09:01:10,840 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-09-28 09:01:10,842 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-09-28 09:01:10,843 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-09-28 09:01:10,857 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-09-28 09:01:10,857 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 09:01:10,857 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-09-28 09:01:10,857 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-09-28 09:01:10,860 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-28 09:01:10,862 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/hbase/meta/1588230740/info 2023-09-28 09:01:10,862 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/hbase/meta/1588230740/info 2023-09-28 09:01:10,863 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-28 09:01:10,864 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 09:01:10,864 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-28 09:01:10,866 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/hbase/meta/1588230740/rep_barrier 2023-09-28 09:01:10,866 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/hbase/meta/1588230740/rep_barrier 2023-09-28 09:01:10,867 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-28 09:01:10,867 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 09:01:10,868 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-28 09:01:10,870 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/hbase/meta/1588230740/table 2023-09-28 09:01:10,870 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/hbase/meta/1588230740/table 2023-09-28 09:01:10,872 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-28 09:01:10,874 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 09:01:10,875 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/hbase/meta/1588230740 2023-09-28 09:01:10,878 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/hbase/meta/1588230740 2023-09-28 09:01:10,882 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-28 09:01:10,884 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-28 09:01:10,886 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64559164, jitterRate=-0.03799349069595337}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-28 09:01:10,890 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-28 09:01:10,902 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1695891670778 2023-09-28 09:01:10,925 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-09-28 09:01:10,926 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-09-28 09:01:10,927 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40311,1695891668959, state=OPEN 2023-09-28 09:01:10,930 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-09-28 09:01:10,930 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-28 09:01:10,935 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-09-28 09:01:10,935 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40311,1695891668959 in 332 msec 2023-09-28 09:01:10,940 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-09-28 09:01:10,940 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 546 msec 2023-09-28 09:01:10,945 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 830 msec 2023-09-28 09:01:10,946 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1695891670946, completionTime=-1 2023-09-28 09:01:10,946 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-09-28 09:01:10,946 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-09-28 09:01:11,022 DEBUG [hconnection-0x3ff53656-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 09:01:11,026 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39742, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 09:01:11,046 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-09-28 09:01:11,046 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1695891731046 2023-09-28 09:01:11,046 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1695891791046 2023-09-28 09:01:11,046 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 100 msec 2023-09-28 09:01:11,071 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40293,1695891667656-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-28 09:01:11,071 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40293,1695891667656-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-28 09:01:11,071 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40293,1695891667656-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-28 09:01:11,073 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:40293, period=300000, unit=MILLISECONDS is enabled. 2023-09-28 09:01:11,073 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-09-28 09:01:11,086 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-09-28 09:01:11,096 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-09-28 09:01:11,097 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-28 09:01:11,107 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-09-28 09:01:11,109 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-09-28 09:01:11,112 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-28 09:01:11,135 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/hbase/namespace/e02133285b6f183c0299d48a8ce537ee 2023-09-28 09:01:11,138 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/hbase/namespace/e02133285b6f183c0299d48a8ce537ee empty. 2023-09-28 09:01:11,138 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/hbase/namespace/e02133285b6f183c0299d48a8ce537ee 2023-09-28 09:01:11,138 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-09-28 09:01:11,175 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-09-28 09:01:11,177 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => e02133285b6f183c0299d48a8ce537ee, NAME => 'hbase:namespace,,1695891671097.e02133285b6f183c0299d48a8ce537ee.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp 2023-09-28 09:01:11,199 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695891671097.e02133285b6f183c0299d48a8ce537ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 09:01:11,199 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing e02133285b6f183c0299d48a8ce537ee, disabling compactions & flushes 2023-09-28 09:01:11,200 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695891671097.e02133285b6f183c0299d48a8ce537ee. 2023-09-28 09:01:11,200 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695891671097.e02133285b6f183c0299d48a8ce537ee. 2023-09-28 09:01:11,200 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695891671097.e02133285b6f183c0299d48a8ce537ee. after waiting 0 ms 2023-09-28 09:01:11,200 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695891671097.e02133285b6f183c0299d48a8ce537ee. 2023-09-28 09:01:11,200 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695891671097.e02133285b6f183c0299d48a8ce537ee. 2023-09-28 09:01:11,200 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for e02133285b6f183c0299d48a8ce537ee: 2023-09-28 09:01:11,205 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-09-28 09:01:11,220 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1695891671097.e02133285b6f183c0299d48a8ce537ee.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695891671208"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695891671208"}]},"ts":"1695891671208"} 2023-09-28 09:01:11,248 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-28 09:01:11,250 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-28 09:01:11,254 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695891671250"}]},"ts":"1695891671250"} 2023-09-28 09:01:11,258 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-09-28 09:01:11,263 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-28 09:01:11,265 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-28 09:01:11,265 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-28 09:01:11,265 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-28 09:01:11,265 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-28 09:01:11,267 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e02133285b6f183c0299d48a8ce537ee, ASSIGN}] 2023-09-28 09:01:11,270 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e02133285b6f183c0299d48a8ce537ee, ASSIGN 2023-09-28 09:01:11,272 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=e02133285b6f183c0299d48a8ce537ee, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39195,1695891668910; forceNewPlan=false, retain=false 2023-09-28 09:01:11,424 INFO [jenkins-hbase4:40293] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-28 09:01:11,425 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e02133285b6f183c0299d48a8ce537ee, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:11,426 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1695891671097.e02133285b6f183c0299d48a8ce537ee.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695891671425"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695891671425"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695891671425"}]},"ts":"1695891671425"} 2023-09-28 09:01:11,430 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure e02133285b6f183c0299d48a8ce537ee, server=jenkins-hbase4.apache.org,39195,1695891668910}] 2023-09-28 09:01:11,585 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:11,585 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-28 09:01:11,590 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60336, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-28 09:01:11,596 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1695891671097.e02133285b6f183c0299d48a8ce537ee. 2023-09-28 09:01:11,598 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e02133285b6f183c0299d48a8ce537ee, NAME => 'hbase:namespace,,1695891671097.e02133285b6f183c0299d48a8ce537ee.', STARTKEY => '', ENDKEY => ''} 2023-09-28 09:01:11,598 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1695891671097.e02133285b6f183c0299d48a8ce537ee. service=AccessControlService 2023-09-28 09:01:11,599 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 09:01:11,600 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace e02133285b6f183c0299d48a8ce537ee 2023-09-28 09:01:11,600 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695891671097.e02133285b6f183c0299d48a8ce537ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 09:01:11,600 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e02133285b6f183c0299d48a8ce537ee 2023-09-28 09:01:11,600 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e02133285b6f183c0299d48a8ce537ee 2023-09-28 09:01:11,602 INFO [StoreOpener-e02133285b6f183c0299d48a8ce537ee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region e02133285b6f183c0299d48a8ce537ee 2023-09-28 09:01:11,604 DEBUG [StoreOpener-e02133285b6f183c0299d48a8ce537ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/hbase/namespace/e02133285b6f183c0299d48a8ce537ee/info 2023-09-28 09:01:11,604 DEBUG [StoreOpener-e02133285b6f183c0299d48a8ce537ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/hbase/namespace/e02133285b6f183c0299d48a8ce537ee/info 2023-09-28 09:01:11,605 INFO [StoreOpener-e02133285b6f183c0299d48a8ce537ee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e02133285b6f183c0299d48a8ce537ee columnFamilyName info 2023-09-28 09:01:11,605 INFO [StoreOpener-e02133285b6f183c0299d48a8ce537ee-1] regionserver.HStore(310): Store=e02133285b6f183c0299d48a8ce537ee/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 09:01:11,607 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/hbase/namespace/e02133285b6f183c0299d48a8ce537ee 2023-09-28 09:01:11,608 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/hbase/namespace/e02133285b6f183c0299d48a8ce537ee 2023-09-28 09:01:11,612 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e02133285b6f183c0299d48a8ce537ee 2023-09-28 09:01:11,616 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/hbase/namespace/e02133285b6f183c0299d48a8ce537ee/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 09:01:11,617 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e02133285b6f183c0299d48a8ce537ee; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61557509, jitterRate=-0.08272163569927216}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 09:01:11,617 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e02133285b6f183c0299d48a8ce537ee: 2023-09-28 09:01:11,619 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1695891671097.e02133285b6f183c0299d48a8ce537ee., pid=6, masterSystemTime=1695891671585 2023-09-28 09:01:11,623 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1695891671097.e02133285b6f183c0299d48a8ce537ee. 2023-09-28 09:01:11,624 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1695891671097.e02133285b6f183c0299d48a8ce537ee. 2023-09-28 09:01:11,625 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e02133285b6f183c0299d48a8ce537ee, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:11,625 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1695891671097.e02133285b6f183c0299d48a8ce537ee.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695891671625"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695891671625"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695891671625"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695891671625"}]},"ts":"1695891671625"} 2023-09-28 09:01:11,634 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-09-28 09:01:11,634 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure e02133285b6f183c0299d48a8ce537ee, server=jenkins-hbase4.apache.org,39195,1695891668910 in 200 msec 2023-09-28 09:01:11,638 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-09-28 09:01:11,638 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=e02133285b6f183c0299d48a8ce537ee, ASSIGN in 367 msec 2023-09-28 09:01:11,639 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-28 09:01:11,640 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695891671639"}]},"ts":"1695891671639"} 2023-09-28 09:01:11,642 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-09-28 09:01:11,645 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-09-28 09:01:11,648 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 547 msec 2023-09-28 09:01:11,709 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-09-28 09:01:11,711 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-09-28 09:01:11,711 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-28 09:01:11,734 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 09:01:11,736 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60348, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 09:01:11,748 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-09-28 09:01:11,765 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-28 09:01:11,771 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 30 msec 2023-09-28 09:01:11,782 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-09-28 09:01:11,793 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-28 09:01:11,799 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2023-09-28 09:01:11,808 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-09-28 09:01:11,811 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-09-28 09:01:11,811 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.742sec 2023-09-28 09:01:11,814 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-09-28 09:01:11,816 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-09-28 09:01:11,816 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-09-28 09:01:11,817 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40293,1695891667656-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-09-28 09:01:11,818 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40293,1695891667656-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-09-28 09:01:11,835 DEBUG [Listener at localhost/34939] zookeeper.ReadOnlyZKClient(139): Connect 0x5664efd5 to 127.0.0.1:61959 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 09:01:11,840 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-28 09:01:11,842 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-09-28 09:01:11,844 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-09-28 09:01:11,846 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-28 09:01:11,846 DEBUG [Listener at localhost/34939] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@770c99c9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 09:01:11,849 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/hbase/acl/fc82fa152d0901260f95b1e6be2f3488 2023-09-28 09:01:11,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-09-28 09:01:11,851 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/hbase/acl/fc82fa152d0901260f95b1e6be2f3488 empty. 2023-09-28 09:01:11,854 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/hbase/acl/fc82fa152d0901260f95b1e6be2f3488 2023-09-28 09:01:11,854 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-09-28 09:01:11,864 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-28 09:01:11,866 DEBUG [hconnection-0x1efc3b9f-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 09:01:11,885 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-09-28 09:01:11,886 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39746, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 09:01:11,887 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => fc82fa152d0901260f95b1e6be2f3488, NAME => 'hbase:acl,,1695891671834.fc82fa152d0901260f95b1e6be2f3488.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp 2023-09-28 09:01:11,892 INFO [Listener at localhost/34939] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,40293,1695891667656 2023-09-28 09:01:11,892 INFO [Listener at localhost/34939] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-09-28 09:01:11,892 INFO [Listener at localhost/34939] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/test.cache.data in system properties and HBase conf 2023-09-28 09:01:11,892 INFO [Listener at localhost/34939] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/hadoop.tmp.dir in system properties and HBase conf 2023-09-28 09:01:11,892 INFO [Listener at localhost/34939] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/hadoop.log.dir in system properties and HBase conf 2023-09-28 09:01:11,893 INFO [Listener at localhost/34939] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-28 09:01:11,893 INFO [Listener at localhost/34939] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-28 09:01:11,893 INFO [Listener at localhost/34939] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-28 09:01:11,893 INFO [Listener at localhost/34939] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-28 09:01:11,893 INFO [Listener at localhost/34939] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-28 09:01:11,893 INFO [Listener at localhost/34939] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-28 09:01:11,894 INFO [Listener at localhost/34939] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-28 09:01:11,894 INFO [Listener at localhost/34939] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-28 09:01:11,894 INFO [Listener at localhost/34939] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-28 09:01:11,894 INFO [Listener at localhost/34939] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-28 09:01:11,894 INFO [Listener at localhost/34939] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-28 09:01:11,894 INFO [Listener at localhost/34939] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-28 09:01:11,894 INFO [Listener at localhost/34939] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/nfs.dump.dir in system properties and HBase conf 2023-09-28 09:01:11,894 INFO [Listener at localhost/34939] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/java.io.tmpdir in system properties and HBase conf 2023-09-28 09:01:11,895 INFO [Listener at localhost/34939] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-28 09:01:11,895 INFO [Listener at localhost/34939] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-28 09:01:11,895 INFO [Listener at localhost/34939] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-09-28 09:01:11,915 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695891671834.fc82fa152d0901260f95b1e6be2f3488.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 09:01:11,916 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing fc82fa152d0901260f95b1e6be2f3488, disabling compactions & flushes 2023-09-28 09:01:11,916 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695891671834.fc82fa152d0901260f95b1e6be2f3488. 2023-09-28 09:01:11,916 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695891671834.fc82fa152d0901260f95b1e6be2f3488. 2023-09-28 09:01:11,916 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695891671834.fc82fa152d0901260f95b1e6be2f3488. after waiting 0 ms 2023-09-28 09:01:11,916 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695891671834.fc82fa152d0901260f95b1e6be2f3488. 2023-09-28 09:01:11,916 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1695891671834.fc82fa152d0901260f95b1e6be2f3488. 2023-09-28 09:01:11,916 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for fc82fa152d0901260f95b1e6be2f3488: 2023-09-28 09:01:11,921 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-09-28 09:01:11,923 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1695891671834.fc82fa152d0901260f95b1e6be2f3488.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695891671922"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695891671922"}]},"ts":"1695891671922"} 2023-09-28 09:01:11,926 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-28 09:01:11,927 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-28 09:01:11,927 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695891671927"}]},"ts":"1695891671927"} 2023-09-28 09:01:11,930 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-09-28 09:01:11,935 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-28 09:01:11,936 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-28 09:01:11,936 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-28 09:01:11,936 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-28 09:01:11,936 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-28 09:01:11,936 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=fc82fa152d0901260f95b1e6be2f3488, ASSIGN}] 2023-09-28 09:01:11,939 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=fc82fa152d0901260f95b1e6be2f3488, ASSIGN 2023-09-28 09:01:11,941 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=fc82fa152d0901260f95b1e6be2f3488, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40311,1695891668959; forceNewPlan=false, retain=false 2023-09-28 09:01:11,968 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-28 09:01:12,091 INFO [jenkins-hbase4:40293] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-28 09:01:12,092 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=fc82fa152d0901260f95b1e6be2f3488, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:12,093 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1695891671834.fc82fa152d0901260f95b1e6be2f3488.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695891672092"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695891672092"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695891672092"}]},"ts":"1695891672092"} 2023-09-28 09:01:12,097 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure fc82fa152d0901260f95b1e6be2f3488, server=jenkins-hbase4.apache.org,40311,1695891668959}] 2023-09-28 09:01:12,169 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-28 09:01:12,257 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1695891671834.fc82fa152d0901260f95b1e6be2f3488. 2023-09-28 09:01:12,258 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fc82fa152d0901260f95b1e6be2f3488, NAME => 'hbase:acl,,1695891671834.fc82fa152d0901260f95b1e6be2f3488.', STARTKEY => '', ENDKEY => ''} 2023-09-28 09:01:12,258 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1695891671834.fc82fa152d0901260f95b1e6be2f3488. service=AccessControlService 2023-09-28 09:01:12,258 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 09:01:12,259 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl fc82fa152d0901260f95b1e6be2f3488 2023-09-28 09:01:12,259 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695891671834.fc82fa152d0901260f95b1e6be2f3488.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 09:01:12,259 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fc82fa152d0901260f95b1e6be2f3488 2023-09-28 09:01:12,259 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fc82fa152d0901260f95b1e6be2f3488 2023-09-28 09:01:12,261 INFO [StoreOpener-fc82fa152d0901260f95b1e6be2f3488-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region fc82fa152d0901260f95b1e6be2f3488 2023-09-28 09:01:12,263 DEBUG [StoreOpener-fc82fa152d0901260f95b1e6be2f3488-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/hbase/acl/fc82fa152d0901260f95b1e6be2f3488/l 2023-09-28 09:01:12,264 DEBUG [StoreOpener-fc82fa152d0901260f95b1e6be2f3488-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/hbase/acl/fc82fa152d0901260f95b1e6be2f3488/l 2023-09-28 09:01:12,264 INFO [StoreOpener-fc82fa152d0901260f95b1e6be2f3488-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fc82fa152d0901260f95b1e6be2f3488 columnFamilyName l 2023-09-28 09:01:12,265 INFO [StoreOpener-fc82fa152d0901260f95b1e6be2f3488-1] regionserver.HStore(310): Store=fc82fa152d0901260f95b1e6be2f3488/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 09:01:12,268 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/hbase/acl/fc82fa152d0901260f95b1e6be2f3488 2023-09-28 09:01:12,270 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/hbase/acl/fc82fa152d0901260f95b1e6be2f3488 2023-09-28 09:01:12,275 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fc82fa152d0901260f95b1e6be2f3488 2023-09-28 09:01:12,279 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/hbase/acl/fc82fa152d0901260f95b1e6be2f3488/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 09:01:12,279 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fc82fa152d0901260f95b1e6be2f3488; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72008819, jitterRate=0.07301501929759979}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 09:01:12,280 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fc82fa152d0901260f95b1e6be2f3488: 2023-09-28 09:01:12,283 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1695891671834.fc82fa152d0901260f95b1e6be2f3488., pid=11, masterSystemTime=1695891672250 2023-09-28 09:01:12,286 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1695891671834.fc82fa152d0901260f95b1e6be2f3488. 2023-09-28 09:01:12,286 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1695891671834.fc82fa152d0901260f95b1e6be2f3488. 2023-09-28 09:01:12,287 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=fc82fa152d0901260f95b1e6be2f3488, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:12,288 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1695891671834.fc82fa152d0901260f95b1e6be2f3488.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695891672287"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695891672287"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695891672287"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695891672287"}]},"ts":"1695891672287"} 2023-09-28 09:01:12,295 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-09-28 09:01:12,295 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure fc82fa152d0901260f95b1e6be2f3488, server=jenkins-hbase4.apache.org,40311,1695891668959 in 195 msec 2023-09-28 09:01:12,299 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-09-28 09:01:12,299 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=fc82fa152d0901260f95b1e6be2f3488, ASSIGN in 359 msec 2023-09-28 09:01:12,300 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-28 09:01:12,301 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695891672300"}]},"ts":"1695891672300"} 2023-09-28 09:01:12,303 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-09-28 09:01:12,307 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-09-28 09:01:12,309 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 466 msec 2023-09-28 09:01:12,469 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-28 09:01:12,469 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-09-28 09:01:12,481 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-09-28 09:01:13,166 WARN [Thread-382] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-28 09:01:13,565 INFO [Thread-382] log.Slf4jLog(67): jetty-6.1.26 2023-09-28 09:01:13,571 INFO [Thread-382] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_35609_jobhistory____.bjtl6i/webapp 2023-09-28 09:01:13,744 INFO [Thread-382] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-09-28 09:01:13,744 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-09-28 09:01:13,744 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-28 09:01:13,747 INFO [Thread-382] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-28 09:01:13,833 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-28 09:01:14,162 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-28 09:01:14,507 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-09-28 09:01:14,551 INFO [Thread-382] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:35609 2023-09-28 09:01:14,649 WARN [Listener at jenkins-hbase4.apache.org/33403] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-28 09:01:14,940 WARN [Listener at jenkins-hbase4.apache.org/33403] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-28 09:01:14,941 INFO [Listener at jenkins-hbase4.apache.org/33403] log.Slf4jLog(67): jetty-6.1.26 2023-09-28 09:01:14,950 INFO [Listener at jenkins-hbase4.apache.org/33403] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_39921_cluster____.p7dbxq/webapp 2023-09-28 09:01:15,024 INFO [Listener at jenkins-hbase4.apache.org/33403] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-09-28 09:01:15,024 INFO [Listener at jenkins-hbase4.apache.org/33403] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-09-28 09:01:15,024 INFO [Listener at jenkins-hbase4.apache.org/33403] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-28 09:01:15,025 INFO [Listener at jenkins-hbase4.apache.org/33403] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-28 09:01:15,033 INFO [Listener at jenkins-hbase4.apache.org/33403] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-28 09:01:15,207 INFO [Listener at jenkins-hbase4.apache.org/33403] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-28 09:01:15,335 INFO [Listener at jenkins-hbase4.apache.org/33403] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-28 09:01:15,346 INFO [Listener at jenkins-hbase4.apache.org/33403] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:39921 2023-09-28 09:01:15,840 WARN [Listener at jenkins-hbase4.apache.org/43599] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-28 09:01:15,862 WARN [Listener at jenkins-hbase4.apache.org/43599] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-28 09:01:15,863 INFO [Listener at jenkins-hbase4.apache.org/43599] log.Slf4jLog(67): jetty-6.1.26 2023-09-28 09:01:15,884 INFO [Listener at jenkins-hbase4.apache.org/43599] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_42281_node____6tgwx7/webapp 2023-09-28 09:01:15,962 INFO [Listener at jenkins-hbase4.apache.org/43599] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-28 09:01:15,962 INFO [Listener at jenkins-hbase4.apache.org/43599] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-28 09:01:15,962 INFO [Listener at jenkins-hbase4.apache.org/43599] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-28 09:01:15,962 INFO [Listener at jenkins-hbase4.apache.org/43599] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-28 09:01:15,970 INFO [Listener at jenkins-hbase4.apache.org/43599] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-28 09:01:15,993 INFO [Listener at jenkins-hbase4.apache.org/43599] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-28 09:01:16,081 INFO [Listener at jenkins-hbase4.apache.org/43599] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-28 09:01:16,094 INFO [Listener at jenkins-hbase4.apache.org/43599] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:42281 2023-09-28 09:01:16,264 WARN [Listener at jenkins-hbase4.apache.org/39071] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-28 09:01:16,272 WARN [Listener at jenkins-hbase4.apache.org/39071] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-28 09:01:16,273 INFO [Listener at jenkins-hbase4.apache.org/39071] log.Slf4jLog(67): jetty-6.1.26 2023-09-28 09:01:16,279 INFO [Listener at jenkins-hbase4.apache.org/39071] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_34487_node____.9r6u1c/webapp 2023-09-28 09:01:16,333 INFO [Listener at jenkins-hbase4.apache.org/39071] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-28 09:01:16,333 INFO [Listener at jenkins-hbase4.apache.org/39071] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-28 09:01:16,333 INFO [Listener at jenkins-hbase4.apache.org/39071] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-28 09:01:16,333 INFO [Listener at jenkins-hbase4.apache.org/39071] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-28 09:01:16,343 INFO [Listener at jenkins-hbase4.apache.org/39071] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-28 09:01:16,358 INFO [Listener at jenkins-hbase4.apache.org/39071] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-28 09:01:16,405 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-28 09:01:16,447 INFO [Listener at jenkins-hbase4.apache.org/39071] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-28 09:01:16,458 INFO [Listener at jenkins-hbase4.apache.org/39071] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:34487 2023-09-28 09:01:16,496 INFO [Listener at jenkins-hbase4.apache.org/39071] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-09-28 09:01:16,497 INFO [Listener at jenkins-hbase4.apache.org/39071] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-09-28 09:01:16,579 INFO [Listener at jenkins-hbase4.apache.org/39071] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=707, OpenFileDescriptor=897, MaxFileDescriptor=60000, SystemLoadAverage=121, ProcessCount=164, AvailableMemoryMB=5830 2023-09-28 09:01:16,579 WARN [Listener at jenkins-hbase4.apache.org/39071] hbase.ResourceChecker(130): Thread=707 is superior to 500 2023-09-28 09:01:16,604 DEBUG [Listener at jenkins-hbase4.apache.org/39071] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-09-28 09:01:16,615 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48610, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-09-28 09:01:16,627 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-28 09:01:16,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-09-28 09:01:16,638 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-09-28 09:01:16,639 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-09-28 09:01:16,639 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-09-28 09:01:16,641 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-09-28 09:01:16,641 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-28 09:01:16,642 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-09-28 09:01:16,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-28 09:01:16,647 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportWithTargetName/b18ceabcec9fd4ef144539f80fea44c1 2023-09-28 09:01:16,647 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportWithTargetName/8bb74592f92648b376b89a04b51d69f3 2023-09-28 09:01:16,649 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportWithTargetName/b18ceabcec9fd4ef144539f80fea44c1 empty. 2023-09-28 09:01:16,649 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportWithTargetName/8bb74592f92648b376b89a04b51d69f3 empty. 2023-09-28 09:01:16,651 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportWithTargetName/b18ceabcec9fd4ef144539f80fea44c1 2023-09-28 09:01:16,651 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportWithTargetName/8bb74592f92648b376b89a04b51d69f3 2023-09-28 09:01:16,651 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-28 09:01:16,680 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-09-28 09:01:16,681 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => b18ceabcec9fd4ef144539f80fea44c1, NAME => 'testtb-testExportWithTargetName,,1695891676627.b18ceabcec9fd4ef144539f80fea44c1.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp 2023-09-28 09:01:16,682 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8bb74592f92648b376b89a04b51d69f3, NAME => 'testtb-testExportWithTargetName,1,1695891676627.8bb74592f92648b376b89a04b51d69f3.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp 2023-09-28 09:01:16,716 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695891676627.8bb74592f92648b376b89a04b51d69f3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 09:01:16,716 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 8bb74592f92648b376b89a04b51d69f3, disabling compactions & flushes 2023-09-28 09:01:16,716 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695891676627.8bb74592f92648b376b89a04b51d69f3. 2023-09-28 09:01:16,716 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695891676627.b18ceabcec9fd4ef144539f80fea44c1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 09:01:16,716 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695891676627.8bb74592f92648b376b89a04b51d69f3. 2023-09-28 09:01:16,717 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing b18ceabcec9fd4ef144539f80fea44c1, disabling compactions & flushes 2023-09-28 09:01:16,717 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695891676627.8bb74592f92648b376b89a04b51d69f3. after waiting 0 ms 2023-09-28 09:01:16,717 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695891676627.8bb74592f92648b376b89a04b51d69f3. 2023-09-28 09:01:16,717 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695891676627.b18ceabcec9fd4ef144539f80fea44c1. 2023-09-28 09:01:16,717 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695891676627.8bb74592f92648b376b89a04b51d69f3. 2023-09-28 09:01:16,717 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695891676627.b18ceabcec9fd4ef144539f80fea44c1. 2023-09-28 09:01:16,717 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 8bb74592f92648b376b89a04b51d69f3: 2023-09-28 09:01:16,717 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695891676627.b18ceabcec9fd4ef144539f80fea44c1. after waiting 0 ms 2023-09-28 09:01:16,717 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695891676627.b18ceabcec9fd4ef144539f80fea44c1. 2023-09-28 09:01:16,717 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695891676627.b18ceabcec9fd4ef144539f80fea44c1. 2023-09-28 09:01:16,717 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for b18ceabcec9fd4ef144539f80fea44c1: 2023-09-28 09:01:16,721 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-09-28 09:01:16,722 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695891676627.8bb74592f92648b376b89a04b51d69f3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695891676722"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695891676722"}]},"ts":"1695891676722"} 2023-09-28 09:01:16,722 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695891676627.b18ceabcec9fd4ef144539f80fea44c1.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695891676722"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695891676722"}]},"ts":"1695891676722"} 2023-09-28 09:01:16,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-28 09:01:16,769 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-28 09:01:16,771 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-28 09:01:16,771 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695891676771"}]},"ts":"1695891676771"} 2023-09-28 09:01:16,773 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-09-28 09:01:16,778 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-28 09:01:16,780 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-28 09:01:16,780 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-28 09:01:16,780 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-28 09:01:16,780 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-28 09:01:16,781 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b18ceabcec9fd4ef144539f80fea44c1, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8bb74592f92648b376b89a04b51d69f3, ASSIGN}] 2023-09-28 09:01:16,784 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8bb74592f92648b376b89a04b51d69f3, ASSIGN 2023-09-28 09:01:16,784 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b18ceabcec9fd4ef144539f80fea44c1, ASSIGN 2023-09-28 09:01:16,785 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8bb74592f92648b376b89a04b51d69f3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40311,1695891668959; forceNewPlan=false, retain=false 2023-09-28 09:01:16,786 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b18ceabcec9fd4ef144539f80fea44c1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39195,1695891668910; forceNewPlan=false, retain=false 2023-09-28 09:01:16,935 INFO [jenkins-hbase4:40293] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-28 09:01:16,937 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=b18ceabcec9fd4ef144539f80fea44c1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:16,937 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=8bb74592f92648b376b89a04b51d69f3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:16,938 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695891676627.b18ceabcec9fd4ef144539f80fea44c1.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695891676937"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695891676937"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695891676937"}]},"ts":"1695891676937"} 2023-09-28 09:01:16,938 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695891676627.8bb74592f92648b376b89a04b51d69f3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695891676937"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695891676937"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695891676937"}]},"ts":"1695891676937"} 2023-09-28 09:01:16,941 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure b18ceabcec9fd4ef144539f80fea44c1, server=jenkins-hbase4.apache.org,39195,1695891668910}] 2023-09-28 09:01:16,942 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure 8bb74592f92648b376b89a04b51d69f3, server=jenkins-hbase4.apache.org,40311,1695891668959}] 2023-09-28 09:01:16,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-28 09:01:17,099 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1695891676627.b18ceabcec9fd4ef144539f80fea44c1. 2023-09-28 09:01:17,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b18ceabcec9fd4ef144539f80fea44c1, NAME => 'testtb-testExportWithTargetName,,1695891676627.b18ceabcec9fd4ef144539f80fea44c1.', STARTKEY => '', ENDKEY => '1'} 2023-09-28 09:01:17,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1695891676627.b18ceabcec9fd4ef144539f80fea44c1. service=AccessControlService 2023-09-28 09:01:17,100 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 09:01:17,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName b18ceabcec9fd4ef144539f80fea44c1 2023-09-28 09:01:17,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695891676627.b18ceabcec9fd4ef144539f80fea44c1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 09:01:17,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b18ceabcec9fd4ef144539f80fea44c1 2023-09-28 09:01:17,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b18ceabcec9fd4ef144539f80fea44c1 2023-09-28 09:01:17,108 INFO [StoreOpener-b18ceabcec9fd4ef144539f80fea44c1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b18ceabcec9fd4ef144539f80fea44c1 2023-09-28 09:01:17,108 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1695891676627.8bb74592f92648b376b89a04b51d69f3. 2023-09-28 09:01:17,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8bb74592f92648b376b89a04b51d69f3, NAME => 'testtb-testExportWithTargetName,1,1695891676627.8bb74592f92648b376b89a04b51d69f3.', STARTKEY => '1', ENDKEY => ''} 2023-09-28 09:01:17,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1695891676627.8bb74592f92648b376b89a04b51d69f3. service=AccessControlService 2023-09-28 09:01:17,109 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 09:01:17,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 8bb74592f92648b376b89a04b51d69f3 2023-09-28 09:01:17,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695891676627.8bb74592f92648b376b89a04b51d69f3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 09:01:17,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8bb74592f92648b376b89a04b51d69f3 2023-09-28 09:01:17,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8bb74592f92648b376b89a04b51d69f3 2023-09-28 09:01:17,110 DEBUG [StoreOpener-b18ceabcec9fd4ef144539f80fea44c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportWithTargetName/b18ceabcec9fd4ef144539f80fea44c1/cf 2023-09-28 09:01:17,110 DEBUG [StoreOpener-b18ceabcec9fd4ef144539f80fea44c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportWithTargetName/b18ceabcec9fd4ef144539f80fea44c1/cf 2023-09-28 09:01:17,111 INFO [StoreOpener-8bb74592f92648b376b89a04b51d69f3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8bb74592f92648b376b89a04b51d69f3 2023-09-28 09:01:17,114 DEBUG [StoreOpener-8bb74592f92648b376b89a04b51d69f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportWithTargetName/8bb74592f92648b376b89a04b51d69f3/cf 2023-09-28 09:01:17,114 DEBUG [StoreOpener-8bb74592f92648b376b89a04b51d69f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportWithTargetName/8bb74592f92648b376b89a04b51d69f3/cf 2023-09-28 09:01:17,114 INFO [StoreOpener-b18ceabcec9fd4ef144539f80fea44c1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b18ceabcec9fd4ef144539f80fea44c1 columnFamilyName cf 2023-09-28 09:01:17,115 INFO [StoreOpener-8bb74592f92648b376b89a04b51d69f3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8bb74592f92648b376b89a04b51d69f3 columnFamilyName cf 2023-09-28 09:01:17,117 INFO [StoreOpener-b18ceabcec9fd4ef144539f80fea44c1-1] regionserver.HStore(310): Store=b18ceabcec9fd4ef144539f80fea44c1/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 09:01:17,118 INFO [StoreOpener-8bb74592f92648b376b89a04b51d69f3-1] regionserver.HStore(310): Store=8bb74592f92648b376b89a04b51d69f3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 09:01:17,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportWithTargetName/8bb74592f92648b376b89a04b51d69f3 2023-09-28 09:01:17,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportWithTargetName/b18ceabcec9fd4ef144539f80fea44c1 2023-09-28 09:01:17,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportWithTargetName/8bb74592f92648b376b89a04b51d69f3 2023-09-28 09:01:17,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportWithTargetName/b18ceabcec9fd4ef144539f80fea44c1 2023-09-28 09:01:17,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8bb74592f92648b376b89a04b51d69f3 2023-09-28 09:01:17,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b18ceabcec9fd4ef144539f80fea44c1 2023-09-28 09:01:17,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportWithTargetName/8bb74592f92648b376b89a04b51d69f3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 09:01:17,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportWithTargetName/b18ceabcec9fd4ef144539f80fea44c1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 09:01:17,137 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8bb74592f92648b376b89a04b51d69f3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72657666, jitterRate=0.08268359303474426}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 09:01:17,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8bb74592f92648b376b89a04b51d69f3: 2023-09-28 09:01:17,138 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b18ceabcec9fd4ef144539f80fea44c1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73196317, jitterRate=0.0907101184129715}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 09:01:17,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b18ceabcec9fd4ef144539f80fea44c1: 2023-09-28 09:01:17,139 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1695891676627.8bb74592f92648b376b89a04b51d69f3., pid=16, masterSystemTime=1695891677096 2023-09-28 09:01:17,139 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1695891676627.b18ceabcec9fd4ef144539f80fea44c1., pid=15, masterSystemTime=1695891677093 2023-09-28 09:01:17,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1695891676627.8bb74592f92648b376b89a04b51d69f3. 2023-09-28 09:01:17,141 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1695891676627.8bb74592f92648b376b89a04b51d69f3. 2023-09-28 09:01:17,143 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=8bb74592f92648b376b89a04b51d69f3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:17,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1695891676627.b18ceabcec9fd4ef144539f80fea44c1. 2023-09-28 09:01:17,144 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1695891676627.8bb74592f92648b376b89a04b51d69f3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695891677143"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695891677143"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695891677143"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695891677143"}]},"ts":"1695891677143"} 2023-09-28 09:01:17,144 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1695891676627.b18ceabcec9fd4ef144539f80fea44c1. 2023-09-28 09:01:17,146 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=b18ceabcec9fd4ef144539f80fea44c1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:17,148 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1695891676627.b18ceabcec9fd4ef144539f80fea44c1.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695891677146"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695891677146"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695891677146"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695891677146"}]},"ts":"1695891677146"} 2023-09-28 09:01:17,152 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=14 2023-09-28 09:01:17,152 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure 8bb74592f92648b376b89a04b51d69f3, server=jenkins-hbase4.apache.org,40311,1695891668959 in 207 msec 2023-09-28 09:01:17,155 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=13 2023-09-28 09:01:17,155 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8bb74592f92648b376b89a04b51d69f3, ASSIGN in 371 msec 2023-09-28 09:01:17,157 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure b18ceabcec9fd4ef144539f80fea44c1, server=jenkins-hbase4.apache.org,39195,1695891668910 in 210 msec 2023-09-28 09:01:17,160 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=13, resume processing ppid=12 2023-09-28 09:01:17,160 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b18ceabcec9fd4ef144539f80fea44c1, ASSIGN in 376 msec 2023-09-28 09:01:17,161 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-28 09:01:17,161 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695891677161"}]},"ts":"1695891677161"} 2023-09-28 09:01:17,163 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-09-28 09:01:17,166 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-09-28 09:01:17,171 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-09-28 09:01:17,189 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40311] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-28 09:01:17,224 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-28 09:01:17,224 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-28 09:01:17,224 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-28 09:01:17,224 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-28 09:01:17,224 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-28 09:01:17,231 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-28 09:01:17,231 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-28 09:01:17,231 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-28 09:01:17,231 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-28 09:01:17,235 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 603 msec 2023-09-28 09:01:17,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-28 09:01:17,247 INFO [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-09-28 09:01:17,251 DEBUG [Listener at jenkins-hbase4.apache.org/39071] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-28 09:01:17,253 DEBUG [Listener at jenkins-hbase4.apache.org/39071] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695891676627.b18ceabcec9fd4ef144539f80fea44c1. 2023-09-28 09:01:17,255 INFO [Listener at jenkins-hbase4.apache.org/39071] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-28 09:01:17,281 DEBUG [hconnection-0x1efc3b9f-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 09:01:17,284 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57814, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 09:01:17,300 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-28 09:01:17,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695891677300 (current time:1695891677300). 2023-09-28 09:01:17,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-28 09:01:17,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] zookeeper.ReadOnlyZKClient(139): Connect 0x44c1653f to 127.0.0.1:61959 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 09:01:17,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1f54c2d5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 09:01:17,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 09:01:17,314 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44008, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 09:01:17,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x44c1653f to 127.0.0.1:61959 2023-09-28 09:01:17,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 09:01:17,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] zookeeper.ReadOnlyZKClient(139): Connect 0x5de50c0d to 127.0.0.1:61959 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 09:01:17,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@16699aaf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 09:01:17,326 DEBUG [hconnection-0x77761efe-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 09:01:17,328 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44020, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 09:01:17,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5de50c0d to 127.0.0.1:61959 2023-09-28 09:01:17,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 09:01:17,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-28 09:01:17,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-28 09:01:17,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-28 09:01:17,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-28 09:01:17,388 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-28 09:01:17,389 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695892277389 2023-09-28 09:01:17,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-28 09:01:17,390 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-28 09:01:17,393 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-28 09:01:17,393 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-28 09:01:17,395 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 14 msec 2023-09-28 09:01:17,396 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-28 09:01:17,396 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-28 09:01:17,397 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-28 09:01:17,397 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695892277397 2023-09-28 09:01:17,432 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,433 INFO [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-09-28 09:01:17,433 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 09:01:17,434 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-09-28 09:01:17,434 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-28 09:01:17,434 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,434 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,441 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:01:17,441 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:01:17,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:01:17,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:01:17,441 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:17,441 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:01:17,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:01:17,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:01:17,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:01:17,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:01:17,441 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:17,442 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:17,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,442 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:17,442 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-28 09:01:17,442 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,445 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,445 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-28 09:01:17,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-28 09:01:17,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-28 09:01:17,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,447 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-28 09:01:17,447 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-28 09:01:17,447 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-28 09:01:17,450 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,450 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,450 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,450 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-28 09:01:17,450 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-28 09:01:17,450 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-28 09:01:17,450 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 09:01:17,450 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 09:01:17,451 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-28 09:01:17,452 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-28 09:01:17,450 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 09:01:17,452 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-28 09:01:17,452 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-28 09:01:17,453 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39195,1695891668910' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-28 09:01:17,453 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40045,1695891669000' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-28 09:01:17,453 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-28 09:01:17,454 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-28 09:01:17,454 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40311,1695891668959' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-28 09:01:17,457 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,458 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,458 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:17,458 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:17,458 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:17,458 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:01:17,459 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 09:01:17,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:01:17,459 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,459 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,459 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 09:01:17,459 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 09:01:17,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:01:17,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:01:17,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:17,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:17,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:17,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:01:17,462 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39195,1695891668910' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-28 09:01:17,462 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ee34f7c[Count = 1] remaining members to acquire global barrier 2023-09-28 09:01:17,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:17,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:01:17,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:01:17,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:01:17,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:01:17,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:17,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:17,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:17,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:01:17,466 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40311,1695891668959' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-28 09:01:17,466 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ee34f7c[Count = 0] remaining members to acquire global barrier 2023-09-28 09:01:17,466 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-28 09:01:17,466 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,469 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,469 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,469 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,469 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-28 09:01:17,469 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:17,469 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-28 09:01:17,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,470 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40045,1695891669000' in zk 2023-09-28 09:01:17,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,470 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-28 09:01:17,470 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:17,470 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-28 09:01:17,470 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-28 09:01:17,477 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 09:01:17,477 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 09:01:17,477 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-28 09:01:17,477 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 09:01:17,477 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695891676627.8bb74592f92648b376b89a04b51d69f3. 2023-09-28 09:01:17,478 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 09:01:17,477 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-28 09:01:17,478 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 09:01:17,478 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695891676627.b18ceabcec9fd4ef144539f80fea44c1. 2023-09-28 09:01:17,478 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695891676627.8bb74592f92648b376b89a04b51d69f3. started... 2023-09-28 09:01:17,479 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695891676627.b18ceabcec9fd4ef144539f80fea44c1. started... 2023-09-28 09:01:17,481 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8bb74592f92648b376b89a04b51d69f3: 2023-09-28 09:01:17,481 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b18ceabcec9fd4ef144539f80fea44c1: 2023-09-28 09:01:17,482 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695891676627.8bb74592f92648b376b89a04b51d69f3.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,482 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695891676627.b18ceabcec9fd4ef144539f80fea44c1.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,488 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 09:01:17,488 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 09:01:17,491 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-28 09:01:17,491 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-28 09:01:17,497 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 09:01:17,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-28 09:01:17,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-28 09:01:17,503 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-28 09:01:17,523 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695891676627.b18ceabcec9fd4ef144539f80fea44c1. completed. 2023-09-28 09:01:17,523 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695891676627.b18ceabcec9fd4ef144539f80fea44c1. 2023-09-28 09:01:17,524 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 09:01:17,524 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 09:01:17,524 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:17,524 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-28 09:01:17,524 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39195,1695891668910' in zk 2023-09-28 09:01:17,526 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-28 09:01:17,526 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:17,526 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 09:01:17,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:17,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:01:17,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:01:17,526 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-28 09:01:17,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:01:17,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:01:17,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,530 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695891676627.8bb74592f92648b376b89a04b51d69f3. completed. 2023-09-28 09:01:17,530 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695891676627.8bb74592f92648b376b89a04b51d69f3. 2023-09-28 09:01:17,530 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 09:01:17,530 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 09:01:17,530 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:17,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:17,530 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-28 09:01:17,530 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40311,1695891668959' in zk 2023-09-28 09:01:17,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:17,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:17,532 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-28 09:01:17,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:01:17,532 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 09:01:17,532 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:17,532 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-28 09:01:17,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:17,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:17,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:17,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39195,1695891668910': 2023-09-28 09:01:17,535 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39195,1695891668910' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-28 09:01:17,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:17,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:01:17,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:01:17,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:01:17,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:01:17,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:17,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:17,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:17,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:01:17,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:17,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:17,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:17,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,40311,1695891668959': 2023-09-28 09:01:17,539 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40311,1695891668959' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-28 09:01:17,539 INFO [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-09-28 09:01:17,539 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-28 09:01:17,539 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-28 09:01:17,540 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,540 INFO [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-28 09:01:17,544 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,544 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:01:17,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:01:17,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,544 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,544 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:01:17,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,544 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,544 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:01:17,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,544 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:01:17,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:01:17,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:01:17,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:01:17,545 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:17,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:01:17,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:01:17,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:01:17,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:01:17,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,545 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:17,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:01:17,546 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:17,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:17,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:17,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:17,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:01:17,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,548 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:17,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:17,549 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:17,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:17,549 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:17,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:17,563 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:01:17,563 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:01:17,563 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:17,563 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:01:17,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:01:17,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:01:17,564 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 09:01:17,563 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:01:17,564 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:01:17,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:01:17,563 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:01:17,563 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,565 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:17,565 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-28 09:01:17,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:01:17,564 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:01:17,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:01:17,565 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:01:17,565 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-28 09:01:17,565 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:17,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:01:17,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:01:17,565 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:01:17,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:01:17,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:01:17,566 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:17,566 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,566 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:17,566 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:17,566 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,566 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,566 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-28 09:01:17,585 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,588 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,639 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,640 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-28 09:01:17,640 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,641 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:17,641 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695891677390Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695891677585 (+195 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1695891677585Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1695891677585Writing data manifest for emptySnaptb0-testExportWithTargetName at 1695891677601 (+16 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1695891677627 (+26 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695891677640 (+13 ms) 2023-09-28 09:01:17,643 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-28 09:01:17,646 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 253 msec 2023-09-28 09:01:17,703 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 09:01:17,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-28 09:01:17,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-28 09:01:17,723 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39195] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1695891676627.b18ceabcec9fd4ef144539f80fea44c1. with WAL disabled. Data may be lost in the event of a crash. 2023-09-28 09:01:17,726 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1695891676627.8bb74592f92648b376b89a04b51d69f3. with WAL disabled. Data may be lost in the event of a crash. 2023-09-28 09:01:17,732 DEBUG [Listener at jenkins-hbase4.apache.org/39071] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-28 09:01:17,732 DEBUG [Listener at jenkins-hbase4.apache.org/39071] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695891676627.b18ceabcec9fd4ef144539f80fea44c1. 2023-09-28 09:01:17,732 INFO [Listener at jenkins-hbase4.apache.org/39071] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-28 09:01:17,748 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-28 09:01:17,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695891677748 (current time:1695891677748). 2023-09-28 09:01:17,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-28 09:01:17,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] zookeeper.ReadOnlyZKClient(139): Connect 0x41767f25 to 127.0.0.1:61959 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 09:01:17,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6843a5c0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 09:01:17,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 09:01:17,759 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44024, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 09:01:17,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x41767f25 to 127.0.0.1:61959 2023-09-28 09:01:17,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 09:01:17,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] zookeeper.ReadOnlyZKClient(139): Connect 0x5e4dcca5 to 127.0.0.1:61959 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 09:01:17,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2c300f1e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 09:01:17,769 DEBUG [hconnection-0x59a8c2fd-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 09:01:17,772 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44030, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 09:01:17,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5e4dcca5 to 127.0.0.1:61959 2023-09-28 09:01:17,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 09:01:17,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-28 09:01:17,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-28 09:01:17,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-28 09:01:17,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-28 09:01:17,781 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-28 09:01:17,782 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695892277782 2023-09-28 09:01:17,782 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-28 09:01:17,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-28 09:01:17,784 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-28 09:01:17,784 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-28 09:01:17,785 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-28 09:01:17,785 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-28 09:01:17,787 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-09-28 09:01:17,787 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-28 09:01:17,788 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695892277788 2023-09-28 09:01:17,806 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-09-28 09:01:17,806 INFO [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-09-28 09:01:17,806 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 09:01:17,807 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-09-28 09:01:17,807 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-28 09:01:17,807 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 09:01:17,808 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-28 09:01:17,809 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:01:17,809 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:01:17,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:01:17,809 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:17,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:01:17,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:01:17,809 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:01:17,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:01:17,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:01:17,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:01:17,810 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:17,810 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:17,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-28 09:01:17,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-28 09:01:17,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-28 09:01:17,810 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 09:01:17,810 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 09:01:17,810 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 09:01:17,810 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:17,811 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-28 09:01:17,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-28 09:01:17,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-28 09:01:17,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-28 09:01:17,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-28 09:01:17,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-28 09:01:17,811 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-28 09:01:17,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-28 09:01:17,811 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-28 09:01:17,811 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-28 09:01:17,811 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-28 09:01:17,811 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-28 09:01:17,811 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-28 09:01:17,811 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-28 09:01:17,811 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-28 09:01:17,811 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-28 09:01:17,811 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 09:01:17,811 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 09:01:17,812 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-28 09:01:17,813 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-28 09:01:17,813 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-28 09:01:17,812 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 09:01:17,813 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40045,1695891669000' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-28 09:01:17,814 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-28 09:01:17,814 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-28 09:01:17,813 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-28 09:01:17,814 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39195,1695891668910' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-28 09:01:17,814 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40311,1695891668959' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-28 09:01:17,817 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 09:01:17,817 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:17,817 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 09:01:17,817 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:17,817 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 09:01:17,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:17,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:01:17,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:01:17,817 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 09:01:17,817 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 09:01:17,818 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 09:01:17,818 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 09:01:17,818 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 09:01:17,818 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 09:01:17,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:01:17,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:01:17,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-28 09:01:17,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:17,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:17,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:17,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:01:17,820 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39195,1695891668910' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-28 09:01:17,820 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c27f102[Count = 1] remaining members to acquire global barrier 2023-09-28 09:01:17,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:17,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:01:17,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:01:17,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:01:17,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:01:17,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-28 09:01:17,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:17,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:17,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:17,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:01:17,823 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40311,1695891668959' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-28 09:01:17,823 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c27f102[Count = 0] remaining members to acquire global barrier 2023-09-28 09:01:17,823 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-28 09:01:17,823 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 09:01:17,828 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 09:01:17,828 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 09:01:17,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 09:01:17,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 09:01:17,828 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 09:01:17,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 09:01:17,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 09:01:17,829 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-28 09:01:17,829 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:17,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 09:01:17,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 09:01:17,829 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-28 09:01:17,829 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-28 09:01:17,829 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695891676627.b18ceabcec9fd4ef144539f80fea44c1. 2023-09-28 09:01:17,829 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:17,829 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-28 09:01:17,829 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-28 09:01:17,829 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695891676627.8bb74592f92648b376b89a04b51d69f3. 2023-09-28 09:01:17,829 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 09:01:17,829 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 09:01:17,829 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695891676627.8bb74592f92648b376b89a04b51d69f3. started... 2023-09-28 09:01:17,829 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40045,1695891669000' in zk 2023-09-28 09:01:17,829 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695891676627.b18ceabcec9fd4ef144539f80fea44c1. started... 2023-09-28 09:01:17,829 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 09:01:17,830 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 09:01:17,830 INFO [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b18ceabcec9fd4ef144539f80fea44c1 1/1 column families, dataSize=132 B heapSize=544 B 2023-09-28 09:01:17,830 INFO [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8bb74592f92648b376b89a04b51d69f3 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-09-28 09:01:17,833 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-28 09:01:17,833 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 09:01:17,833 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-28 09:01:17,844 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 09:01:17,845 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-09-28 09:01:17,845 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 09:01:17,845 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-09-28 09:01:17,845 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-28 09:01:17,845 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-09-28 09:01:17,845 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 09:01:17,845 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-09-28 09:01:17,846 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-28 09:01:17,846 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-09-28 09:01:17,884 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 09:01:17,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-28 09:01:17,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-28 09:01:17,886 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-28 09:01:17,969 INFO [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230928487889ac65364862ad773e2942ba7720 to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230928487889ac65364862ad773e2942ba7720 2023-09-28 09:01:17,969 INFO [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230928996f6fe99b434270adad20926c10832c to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230928996f6fe99b434270adad20926c10832c 2023-09-28 09:01:18,011 INFO [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportWithTargetName/b18ceabcec9fd4ef144539f80fea44c1/.tmp/cf/bb4b56a6e6164dd699d699ccf2f4252d 2023-09-28 09:01:18,012 INFO [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportWithTargetName/8bb74592f92648b376b89a04b51d69f3/.tmp/cf/35a54da2a57541be8269860b8f140cd9 2023-09-28 09:01:18,023 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportWithTargetName/8bb74592f92648b376b89a04b51d69f3/.tmp/cf/35a54da2a57541be8269860b8f140cd9 as hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportWithTargetName/8bb74592f92648b376b89a04b51d69f3/cf/35a54da2a57541be8269860b8f140cd9 2023-09-28 09:01:18,023 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportWithTargetName/b18ceabcec9fd4ef144539f80fea44c1/.tmp/cf/bb4b56a6e6164dd699d699ccf2f4252d as hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportWithTargetName/b18ceabcec9fd4ef144539f80fea44c1/cf/bb4b56a6e6164dd699d699ccf2f4252d 2023-09-28 09:01:18,033 INFO [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportWithTargetName/8bb74592f92648b376b89a04b51d69f3/cf/35a54da2a57541be8269860b8f140cd9, entries=48, sequenceid=6, filesize=13.0 K 2023-09-28 09:01:18,035 INFO [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportWithTargetName/b18ceabcec9fd4ef144539f80fea44c1/cf/bb4b56a6e6164dd699d699ccf2f4252d, entries=2, sequenceid=6, filesize=5.2 K 2023-09-28 09:01:18,039 INFO [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for b18ceabcec9fd4ef144539f80fea44c1 in 209ms, sequenceid=6, compaction requested=false 2023-09-28 09:01:18,039 INFO [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 8bb74592f92648b376b89a04b51d69f3 in 209ms, sequenceid=6, compaction requested=false 2023-09-28 09:01:18,039 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-28 09:01:18,039 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-28 09:01:18,041 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8bb74592f92648b376b89a04b51d69f3: 2023-09-28 09:01:18,041 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b18ceabcec9fd4ef144539f80fea44c1: 2023-09-28 09:01:18,041 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695891676627.b18ceabcec9fd4ef144539f80fea44c1.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-28 09:01:18,041 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695891676627.8bb74592f92648b376b89a04b51d69f3.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-28 09:01:18,042 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 09:01:18,042 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 09:01:18,042 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportWithTargetName/b18ceabcec9fd4ef144539f80fea44c1/cf/bb4b56a6e6164dd699d699ccf2f4252d] hfiles 2023-09-28 09:01:18,042 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportWithTargetName/8bb74592f92648b376b89a04b51d69f3/cf/35a54da2a57541be8269860b8f140cd9] hfiles 2023-09-28 09:01:18,042 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportWithTargetName/b18ceabcec9fd4ef144539f80fea44c1/cf/bb4b56a6e6164dd699d699ccf2f4252d for snapshot=snaptb0-testExportWithTargetName 2023-09-28 09:01:18,042 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportWithTargetName/8bb74592f92648b376b89a04b51d69f3/cf/35a54da2a57541be8269860b8f140cd9 for snapshot=snaptb0-testExportWithTargetName 2023-09-28 09:01:18,067 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695891676627.b18ceabcec9fd4ef144539f80fea44c1. completed. 2023-09-28 09:01:18,068 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695891676627.b18ceabcec9fd4ef144539f80fea44c1. 2023-09-28 09:01:18,068 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 09:01:18,068 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 09:01:18,068 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695891676627.8bb74592f92648b376b89a04b51d69f3. completed. 2023-09-28 09:01:18,068 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:18,068 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695891676627.8bb74592f92648b376b89a04b51d69f3. 2023-09-28 09:01:18,068 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-28 09:01:18,068 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39195,1695891668910' in zk 2023-09-28 09:01:18,068 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 09:01:18,068 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 09:01:18,068 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:18,068 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-28 09:01:18,068 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40311,1695891668959' in zk 2023-09-28 09:01:18,070 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-28 09:01:18,070 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:18,070 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 09:01:18,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:18,070 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-28 09:01:18,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:01:18,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:01:18,072 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:18,072 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-28 09:01:18,072 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 09:01:18,072 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-28 09:01:18,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:01:18,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:01:18,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-28 09:01:18,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:18,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:18,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:18,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:01:18,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-28 09:01:18,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:18,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:18,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:18,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39195,1695891668910': 2023-09-28 09:01:18,078 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39195,1695891668910' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-28 09:01:18,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:18,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:01:18,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:01:18,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:01:18,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:01:18,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-28 09:01:18,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:18,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:18,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:18,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:01:18,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-28 09:01:18,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:18,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:18,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:18,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,40311,1695891668959': 2023-09-28 09:01:18,083 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40311,1695891668959' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-28 09:01:18,083 INFO [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-09-28 09:01:18,083 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-28 09:01:18,083 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-28 09:01:18,083 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-09-28 09:01:18,083 INFO [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-28 09:01:18,085 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 09:01:18,085 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 09:01:18,085 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:01:18,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 09:01:18,085 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 09:01:18,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 09:01:18,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 09:01:18,085 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 09:01:18,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 09:01:18,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 09:01:18,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 09:01:18,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 09:01:18,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:01:18,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:01:18,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:01:18,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:01:18,086 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 09:01:18,085 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:01:18,086 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:01:18,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:01:18,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:01:18,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 09:01:18,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:01:18,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:01:18,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:01:18,087 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:18,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-28 09:01:18,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-28 09:01:18,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 09:01:18,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-28 09:01:18,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 09:01:18,088 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-28 09:01:18,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:01:18,088 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:18,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-28 09:01:18,089 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:18,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:18,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:18,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:18,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:01:18,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-28 09:01:18,092 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:18,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:18,092 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:18,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:18,093 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:18,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:18,105 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:01:18,105 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:18,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:01:18,105 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-28 09:01:18,106 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:01:18,106 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:18,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:01:18,106 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 09:01:18,105 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:01:18,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:01:18,106 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-09-28 09:01:18,106 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:18,106 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:01:18,107 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-28 09:01:18,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:01:18,107 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:18,107 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-28 09:01:18,107 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:01:18,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:01:18,107 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:01:18,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:01:18,107 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-28 09:01:18,107 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 09:01:18,107 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-28 09:01:18,107 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:18,108 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:18,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:01:18,108 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 09:01:18,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:01:18,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:01:18,108 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 09:01:18,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:01:18,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:01:18,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:01:18,109 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230928996f6fe99b434270adad20926c10832c, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230928487889ac65364862ad773e2942ba7720] mob files 2023-09-28 09:01:18,109 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230928996f6fe99b434270adad20926c10832c 2023-09-28 09:01:18,109 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230928487889ac65364862ad773e2942ba7720 2023-09-28 09:01:18,126 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-09-28 09:01:18,127 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-28 09:01:18,162 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-28 09:01:18,163 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-28 09:01:18,163 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-28 09:01:18,164 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-28 09:01:18,164 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695891677782Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695891678126 (+344 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1695891678126Loading Region manifests for snaptb0-testExportWithTargetName at 1695891678126Writing data manifest for snaptb0-testExportWithTargetName at 1695891678131 (+5 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1695891678151 (+20 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695891678163 (+12 ms) 2023-09-28 09:01:18,166 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-28 09:01:18,169 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 384 msec 2023-09-28 09:01:18,388 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 09:01:18,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-28 09:01:18,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-28 09:01:18,392 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/export-test/export-1695891678392 2023-09-28 09:01:18,393 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:39781, tgtDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/export-test/export-1695891678392, rawTgtDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/export-test/export-1695891678392, srcFsUri=hdfs://localhost:39781, srcDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba 2023-09-28 09:01:18,438 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39781, inputRoot=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba 2023-09-28 09:01:18,438 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1456322682_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/export-test/export-1695891678392, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/export-test/export-1695891678392/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-28 09:01:18,438 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39781, inputRoot=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba, snapshotDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-09-28 09:01:18,456 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/export-test/export-1695891678392/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-28 09:01:18,520 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-28 09:01:18,521 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-28 09:01:18,521 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-28 09:01:18,521 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-28 09:01:19,472 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/hadoop-4128172842990173053.jar 2023-09-28 09:01:19,473 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-28 09:01:19,473 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-28 09:01:19,543 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/hadoop-5522789689203233969.jar 2023-09-28 09:01:19,544 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-28 09:01:19,544 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-28 09:01:19,545 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-28 09:01:19,545 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-28 09:01:19,545 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-28 09:01:19,546 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-28 09:01:19,546 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-28 09:01:19,547 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-28 09:01:19,547 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-28 09:01:19,548 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-28 09:01:19,548 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-28 09:01:19,549 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-28 09:01:19,550 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-28 09:01:19,550 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-28 09:01:19,551 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-28 09:01:19,552 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-28 09:01:19,557 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 09:01:19,558 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 09:01:19,558 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 09:01:19,559 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 09:01:19,559 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 09:01:19,560 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 09:01:19,560 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 09:01:20,401 WARN [Listener at jenkins-hbase4.apache.org/39071] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-28 09:01:20,408 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-09-28 09:01:20,419 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-28 09:01:20,873 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 09:01:20,875 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 09:01:21,363 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695891675416_0001_000001 (auth:SIMPLE) 2023-09-28 09:01:22,606 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-28 09:01:25,614 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695891675416_0001_000001 (auth:SIMPLE) 2023-09-28 09:01:27,864 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695891675416_0001_000001 (auth:SIMPLE) 2023-09-28 09:01:30,670 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695891675416_0001_000001 (auth:SIMPLE) 2023-09-28 09:01:32,263 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-28 09:01:32,267 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-28 09:01:32,279 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-09-28 09:01:32,279 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-28 09:01:32,280 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-28 09:01:32,280 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1698010877_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-28 09:01:32,281 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(367): hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-09-28 09:01:32,281 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(367): hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-09-28 09:01:32,281 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1698010877_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/export-test/export-1695891678392/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/export-test/export-1695891678392/.hbase-snapshot/testExportWithTargetName 2023-09-28 09:01:32,282 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(367): hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/export-test/export-1695891678392/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-09-28 09:01:32,282 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(367): hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/export-test/export-1695891678392/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-09-28 09:01:32,294 INFO [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-09-28 09:01:32,300 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-09-28 09:01:32,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-09-28 09:01:32,314 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695891692314"}]},"ts":"1695891692314"} 2023-09-28 09:01:32,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-28 09:01:32,316 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-09-28 09:01:32,318 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-09-28 09:01:32,320 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b18ceabcec9fd4ef144539f80fea44c1, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8bb74592f92648b376b89a04b51d69f3, UNASSIGN}] 2023-09-28 09:01:32,322 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b18ceabcec9fd4ef144539f80fea44c1, UNASSIGN 2023-09-28 09:01:32,322 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8bb74592f92648b376b89a04b51d69f3, UNASSIGN 2023-09-28 09:01:32,323 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=b18ceabcec9fd4ef144539f80fea44c1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:32,323 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=8bb74592f92648b376b89a04b51d69f3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:32,324 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695891676627.b18ceabcec9fd4ef144539f80fea44c1.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695891692323"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695891692323"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695891692323"}]},"ts":"1695891692323"} 2023-09-28 09:01:32,324 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695891676627.8bb74592f92648b376b89a04b51d69f3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695891692323"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695891692323"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695891692323"}]},"ts":"1695891692323"} 2023-09-28 09:01:32,326 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure b18ceabcec9fd4ef144539f80fea44c1, server=jenkins-hbase4.apache.org,39195,1695891668910}] 2023-09-28 09:01:32,327 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 8bb74592f92648b376b89a04b51d69f3, server=jenkins-hbase4.apache.org,40311,1695891668959}] 2023-09-28 09:01:32,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-28 09:01:32,488 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8bb74592f92648b376b89a04b51d69f3 2023-09-28 09:01:32,488 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b18ceabcec9fd4ef144539f80fea44c1 2023-09-28 09:01:32,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8bb74592f92648b376b89a04b51d69f3, disabling compactions & flushes 2023-09-28 09:01:32,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b18ceabcec9fd4ef144539f80fea44c1, disabling compactions & flushes 2023-09-28 09:01:32,488 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695891676627.8bb74592f92648b376b89a04b51d69f3. 2023-09-28 09:01:32,488 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695891676627.b18ceabcec9fd4ef144539f80fea44c1. 2023-09-28 09:01:32,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695891676627.8bb74592f92648b376b89a04b51d69f3. 2023-09-28 09:01:32,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695891676627.b18ceabcec9fd4ef144539f80fea44c1. 2023-09-28 09:01:32,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695891676627.8bb74592f92648b376b89a04b51d69f3. after waiting 0 ms 2023-09-28 09:01:32,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695891676627.b18ceabcec9fd4ef144539f80fea44c1. after waiting 0 ms 2023-09-28 09:01:32,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695891676627.8bb74592f92648b376b89a04b51d69f3. 2023-09-28 09:01:32,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695891676627.b18ceabcec9fd4ef144539f80fea44c1. 2023-09-28 09:01:32,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportWithTargetName/b18ceabcec9fd4ef144539f80fea44c1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-28 09:01:32,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportWithTargetName/8bb74592f92648b376b89a04b51d69f3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-28 09:01:32,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 09:01:32,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 09:01:32,510 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695891676627.b18ceabcec9fd4ef144539f80fea44c1. 2023-09-28 09:01:32,510 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695891676627.8bb74592f92648b376b89a04b51d69f3. 2023-09-28 09:01:32,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b18ceabcec9fd4ef144539f80fea44c1: 2023-09-28 09:01:32,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8bb74592f92648b376b89a04b51d69f3: 2023-09-28 09:01:32,512 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8bb74592f92648b376b89a04b51d69f3 2023-09-28 09:01:32,513 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=8bb74592f92648b376b89a04b51d69f3, regionState=CLOSED 2023-09-28 09:01:32,513 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695891676627.8bb74592f92648b376b89a04b51d69f3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695891692513"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695891692513"}]},"ts":"1695891692513"} 2023-09-28 09:01:32,513 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b18ceabcec9fd4ef144539f80fea44c1 2023-09-28 09:01:32,514 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=b18ceabcec9fd4ef144539f80fea44c1, regionState=CLOSED 2023-09-28 09:01:32,514 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695891676627.b18ceabcec9fd4ef144539f80fea44c1.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695891692514"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695891692514"}]},"ts":"1695891692514"} 2023-09-28 09:01:32,518 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=23 2023-09-28 09:01:32,519 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 8bb74592f92648b376b89a04b51d69f3, server=jenkins-hbase4.apache.org,40311,1695891668959 in 188 msec 2023-09-28 09:01:32,519 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=22 2023-09-28 09:01:32,520 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure b18ceabcec9fd4ef144539f80fea44c1, server=jenkins-hbase4.apache.org,39195,1695891668910 in 191 msec 2023-09-28 09:01:32,521 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8bb74592f92648b376b89a04b51d69f3, UNASSIGN in 199 msec 2023-09-28 09:01:32,523 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=22, resume processing ppid=21 2023-09-28 09:01:32,523 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b18ceabcec9fd4ef144539f80fea44c1, UNASSIGN in 200 msec 2023-09-28 09:01:32,524 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695891692524"}]},"ts":"1695891692524"} 2023-09-28 09:01:32,525 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-09-28 09:01:32,527 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-09-28 09:01:32,530 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 225 msec 2023-09-28 09:01:32,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-28 09:01:32,618 INFO [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-09-28 09:01:32,623 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-09-28 09:01:32,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-28 09:01:32,633 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-28 09:01:32,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-09-28 09:01:32,635 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-28 09:01:32,638 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40311] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-09-28 09:01:32,641 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportWithTargetName/b18ceabcec9fd4ef144539f80fea44c1 2023-09-28 09:01:32,641 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportWithTargetName/8bb74592f92648b376b89a04b51d69f3 2023-09-28 09:01:32,642 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-28 09:01:32,642 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-28 09:01:32,642 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-28 09:01:32,642 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-28 09:01:32,644 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 09:01:32,644 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 09:01:32,644 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 09:01:32,644 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 09:01:32,644 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-28 09:01:32,644 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-28 09:01:32,644 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-28 09:01:32,644 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-28 09:01:32,645 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-28 09:01:32,645 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-28 09:01:32,645 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-28 09:01:32,645 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-28 09:01:32,645 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportWithTargetName/8bb74592f92648b376b89a04b51d69f3/cf, FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportWithTargetName/8bb74592f92648b376b89a04b51d69f3/recovered.edits] 2023-09-28 09:01:32,645 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportWithTargetName/b18ceabcec9fd4ef144539f80fea44c1/cf, FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportWithTargetName/b18ceabcec9fd4ef144539f80fea44c1/recovered.edits] 2023-09-28 09:01:32,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-28 09:01:32,655 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportWithTargetName/b18ceabcec9fd4ef144539f80fea44c1/cf/bb4b56a6e6164dd699d699ccf2f4252d to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/archive/data/default/testtb-testExportWithTargetName/b18ceabcec9fd4ef144539f80fea44c1/cf/bb4b56a6e6164dd699d699ccf2f4252d 2023-09-28 09:01:32,655 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportWithTargetName/8bb74592f92648b376b89a04b51d69f3/cf/35a54da2a57541be8269860b8f140cd9 to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/archive/data/default/testtb-testExportWithTargetName/8bb74592f92648b376b89a04b51d69f3/cf/35a54da2a57541be8269860b8f140cd9 2023-09-28 09:01:32,659 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportWithTargetName/b18ceabcec9fd4ef144539f80fea44c1/recovered.edits/9.seqid to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/archive/data/default/testtb-testExportWithTargetName/b18ceabcec9fd4ef144539f80fea44c1/recovered.edits/9.seqid 2023-09-28 09:01:32,659 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportWithTargetName/8bb74592f92648b376b89a04b51d69f3/recovered.edits/9.seqid to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/archive/data/default/testtb-testExportWithTargetName/8bb74592f92648b376b89a04b51d69f3/recovered.edits/9.seqid 2023-09-28 09:01:32,660 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportWithTargetName/b18ceabcec9fd4ef144539f80fea44c1 2023-09-28 09:01:32,660 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportWithTargetName/8bb74592f92648b376b89a04b51d69f3 2023-09-28 09:01:32,660 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-28 09:01:32,661 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-28 09:01:32,662 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-09-28 09:01:32,666 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230928996f6fe99b434270adad20926c10832c to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230928996f6fe99b434270adad20926c10832c 2023-09-28 09:01:32,667 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230928487889ac65364862ad773e2942ba7720 to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230928487889ac65364862ad773e2942ba7720 2023-09-28 09:01:32,668 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-28 09:01:32,671 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-28 09:01:32,693 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-09-28 09:01:32,696 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-09-28 09:01:32,698 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-28 09:01:32,698 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-09-28 09:01:32,698 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1695891676627.b18ceabcec9fd4ef144539f80fea44c1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695891692698"}]},"ts":"9223372036854775807"} 2023-09-28 09:01:32,698 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1695891676627.8bb74592f92648b376b89a04b51d69f3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695891692698"}]},"ts":"9223372036854775807"} 2023-09-28 09:01:32,700 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-28 09:01:32,700 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b18ceabcec9fd4ef144539f80fea44c1, NAME => 'testtb-testExportWithTargetName,,1695891676627.b18ceabcec9fd4ef144539f80fea44c1.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 8bb74592f92648b376b89a04b51d69f3, NAME => 'testtb-testExportWithTargetName,1,1695891676627.8bb74592f92648b376b89a04b51d69f3.', STARTKEY => '1', ENDKEY => ''}] 2023-09-28 09:01:32,700 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-09-28 09:01:32,700 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695891692700"}]},"ts":"9223372036854775807"} 2023-09-28 09:01:32,702 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-09-28 09:01:32,705 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-28 09:01:32,707 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 81 msec 2023-09-28 09:01:32,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-28 09:01:32,753 INFO [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-09-28 09:01:32,774 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-09-28 09:01:32,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-09-28 09:01:32,780 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-09-28 09:01:32,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-09-28 09:01:32,814 INFO [Listener at jenkins-hbase4.apache.org/39071] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=755 (was 707) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (32912118) connection to jenkins-hbase4.apache.org/172.31.14.131:43599 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/cluster_cdbda8d1-4c7c-df9a-692b-a4fb20b2dac6/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3ff53656-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-598053512_1 at /127.0.0.1:33120 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3ff53656-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1698010877_17 at /127.0.0.1:37488 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (32912118) connection to jenkins-hbase4.apache.org/172.31.14.131:36645 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/cluster_cdbda8d1-4c7c-df9a-692b-a4fb20b2dac6/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (32912118) connection to jenkins-hbase4.apache.org/172.31.14.131:45285 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Thread-1282 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-598053512_1 at /127.0.0.1:34338 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/cluster_cdbda8d1-4c7c-df9a-692b-a4fb20b2dac6/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1698010877_17 at /127.0.0.1:33144 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/cluster_cdbda8d1-4c7c-df9a-692b-a4fb20b2dac6/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3ff53656-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3ff53656-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1698010877_17 at /127.0.0.1:34350 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/cluster_cdbda8d1-4c7c-df9a-692b-a4fb20b2dac6/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/cluster_cdbda8d1-4c7c-df9a-692b-a4fb20b2dac6/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=922 (was 897) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=122 (was 121) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 164) - ProcessCount LEAK? -, AvailableMemoryMB=5008 (was 5830) 2023-09-28 09:01:32,815 WARN [Listener at jenkins-hbase4.apache.org/39071] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-09-28 09:01:32,837 INFO [Listener at jenkins-hbase4.apache.org/39071] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=755, OpenFileDescriptor=922, MaxFileDescriptor=60000, SystemLoadAverage=122, ProcessCount=167, AvailableMemoryMB=5007 2023-09-28 09:01:32,837 WARN [Listener at jenkins-hbase4.apache.org/39071] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-09-28 09:01:32,840 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-28 09:01:32,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-09-28 09:01:32,844 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-28 09:01:32,845 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-09-28 09:01:32,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-28 09:01:32,846 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-28 09:01:32,849 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemState/d70a5e6269652956b640870973157b27 2023-09-28 09:01:32,849 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemState/fe479ee53526382623d9b6dd95f6b0b6 2023-09-28 09:01:32,850 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemState/fe479ee53526382623d9b6dd95f6b0b6 empty. 2023-09-28 09:01:32,850 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemState/d70a5e6269652956b640870973157b27 empty. 2023-09-28 09:01:32,851 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemState/fe479ee53526382623d9b6dd95f6b0b6 2023-09-28 09:01:32,851 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemState/d70a5e6269652956b640870973157b27 2023-09-28 09:01:32,851 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-28 09:01:32,864 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-28 09:01:32,865 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => d70a5e6269652956b640870973157b27, NAME => 'testtb-testExportFileSystemState,,1695891692839.d70a5e6269652956b640870973157b27.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp 2023-09-28 09:01:32,866 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => fe479ee53526382623d9b6dd95f6b0b6, NAME => 'testtb-testExportFileSystemState,1,1695891692839.fe479ee53526382623d9b6dd95f6b0b6.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp 2023-09-28 09:01:32,898 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695891692839.fe479ee53526382623d9b6dd95f6b0b6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 09:01:32,898 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695891692839.d70a5e6269652956b640870973157b27.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 09:01:32,898 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing fe479ee53526382623d9b6dd95f6b0b6, disabling compactions & flushes 2023-09-28 09:01:32,899 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing d70a5e6269652956b640870973157b27, disabling compactions & flushes 2023-09-28 09:01:32,899 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695891692839.fe479ee53526382623d9b6dd95f6b0b6. 2023-09-28 09:01:32,899 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695891692839.d70a5e6269652956b640870973157b27. 2023-09-28 09:01:32,899 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695891692839.fe479ee53526382623d9b6dd95f6b0b6. 2023-09-28 09:01:32,899 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695891692839.d70a5e6269652956b640870973157b27. 2023-09-28 09:01:32,899 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695891692839.fe479ee53526382623d9b6dd95f6b0b6. after waiting 0 ms 2023-09-28 09:01:32,899 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695891692839.d70a5e6269652956b640870973157b27. after waiting 0 ms 2023-09-28 09:01:32,899 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695891692839.fe479ee53526382623d9b6dd95f6b0b6. 2023-09-28 09:01:32,899 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695891692839.d70a5e6269652956b640870973157b27. 2023-09-28 09:01:32,899 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695891692839.fe479ee53526382623d9b6dd95f6b0b6. 2023-09-28 09:01:32,899 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695891692839.d70a5e6269652956b640870973157b27. 2023-09-28 09:01:32,899 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for d70a5e6269652956b640870973157b27: 2023-09-28 09:01:32,899 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for fe479ee53526382623d9b6dd95f6b0b6: 2023-09-28 09:01:32,902 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-28 09:01:32,903 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695891692839.d70a5e6269652956b640870973157b27.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695891692903"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695891692903"}]},"ts":"1695891692903"} 2023-09-28 09:01:32,904 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695891692839.fe479ee53526382623d9b6dd95f6b0b6.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695891692903"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695891692903"}]},"ts":"1695891692903"} 2023-09-28 09:01:32,906 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-28 09:01:32,907 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-28 09:01:32,908 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695891692907"}]},"ts":"1695891692907"} 2023-09-28 09:01:32,909 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-09-28 09:01:32,913 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-28 09:01:32,914 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-28 09:01:32,914 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-28 09:01:32,914 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-28 09:01:32,914 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-28 09:01:32,915 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d70a5e6269652956b640870973157b27, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fe479ee53526382623d9b6dd95f6b0b6, ASSIGN}] 2023-09-28 09:01:32,917 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fe479ee53526382623d9b6dd95f6b0b6, ASSIGN 2023-09-28 09:01:32,917 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d70a5e6269652956b640870973157b27, ASSIGN 2023-09-28 09:01:32,918 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fe479ee53526382623d9b6dd95f6b0b6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40311,1695891668959; forceNewPlan=false, retain=false 2023-09-28 09:01:32,918 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d70a5e6269652956b640870973157b27, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40045,1695891669000; forceNewPlan=false, retain=false 2023-09-28 09:01:32,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-28 09:01:33,068 INFO [jenkins-hbase4:40293] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-28 09:01:33,071 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=fe479ee53526382623d9b6dd95f6b0b6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:33,071 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=d70a5e6269652956b640870973157b27, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:33,072 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695891692839.fe479ee53526382623d9b6dd95f6b0b6.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695891693071"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695891693071"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695891693071"}]},"ts":"1695891693071"} 2023-09-28 09:01:33,072 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695891692839.d70a5e6269652956b640870973157b27.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695891693071"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695891693071"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695891693071"}]},"ts":"1695891693071"} 2023-09-28 09:01:33,074 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure fe479ee53526382623d9b6dd95f6b0b6, server=jenkins-hbase4.apache.org,40311,1695891668959}] 2023-09-28 09:01:33,075 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure d70a5e6269652956b640870973157b27, server=jenkins-hbase4.apache.org,40045,1695891669000}] 2023-09-28 09:01:33,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-28 09:01:33,230 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:33,230 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-28 09:01:33,234 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33226, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-28 09:01:33,234 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1695891692839.fe479ee53526382623d9b6dd95f6b0b6. 2023-09-28 09:01:33,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fe479ee53526382623d9b6dd95f6b0b6, NAME => 'testtb-testExportFileSystemState,1,1695891692839.fe479ee53526382623d9b6dd95f6b0b6.', STARTKEY => '1', ENDKEY => ''} 2023-09-28 09:01:33,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1695891692839.fe479ee53526382623d9b6dd95f6b0b6. service=AccessControlService 2023-09-28 09:01:33,236 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 09:01:33,236 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState fe479ee53526382623d9b6dd95f6b0b6 2023-09-28 09:01:33,236 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695891692839.fe479ee53526382623d9b6dd95f6b0b6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 09:01:33,236 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fe479ee53526382623d9b6dd95f6b0b6 2023-09-28 09:01:33,236 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fe479ee53526382623d9b6dd95f6b0b6 2023-09-28 09:01:33,240 INFO [StoreOpener-fe479ee53526382623d9b6dd95f6b0b6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region fe479ee53526382623d9b6dd95f6b0b6 2023-09-28 09:01:33,241 DEBUG [StoreOpener-fe479ee53526382623d9b6dd95f6b0b6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemState/fe479ee53526382623d9b6dd95f6b0b6/cf 2023-09-28 09:01:33,242 DEBUG [StoreOpener-fe479ee53526382623d9b6dd95f6b0b6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemState/fe479ee53526382623d9b6dd95f6b0b6/cf 2023-09-28 09:01:33,242 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1695891692839.d70a5e6269652956b640870973157b27. 2023-09-28 09:01:33,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d70a5e6269652956b640870973157b27, NAME => 'testtb-testExportFileSystemState,,1695891692839.d70a5e6269652956b640870973157b27.', STARTKEY => '', ENDKEY => '1'} 2023-09-28 09:01:33,242 INFO [StoreOpener-fe479ee53526382623d9b6dd95f6b0b6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fe479ee53526382623d9b6dd95f6b0b6 columnFamilyName cf 2023-09-28 09:01:33,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1695891692839.d70a5e6269652956b640870973157b27. service=AccessControlService 2023-09-28 09:01:33,243 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 09:01:33,243 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState d70a5e6269652956b640870973157b27 2023-09-28 09:01:33,243 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695891692839.d70a5e6269652956b640870973157b27.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 09:01:33,243 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d70a5e6269652956b640870973157b27 2023-09-28 09:01:33,243 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d70a5e6269652956b640870973157b27 2023-09-28 09:01:33,244 INFO [StoreOpener-fe479ee53526382623d9b6dd95f6b0b6-1] regionserver.HStore(310): Store=fe479ee53526382623d9b6dd95f6b0b6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 09:01:33,245 INFO [StoreOpener-d70a5e6269652956b640870973157b27-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d70a5e6269652956b640870973157b27 2023-09-28 09:01:33,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemState/fe479ee53526382623d9b6dd95f6b0b6 2023-09-28 09:01:33,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemState/fe479ee53526382623d9b6dd95f6b0b6 2023-09-28 09:01:33,247 DEBUG [StoreOpener-d70a5e6269652956b640870973157b27-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemState/d70a5e6269652956b640870973157b27/cf 2023-09-28 09:01:33,247 DEBUG [StoreOpener-d70a5e6269652956b640870973157b27-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemState/d70a5e6269652956b640870973157b27/cf 2023-09-28 09:01:33,247 INFO [StoreOpener-d70a5e6269652956b640870973157b27-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d70a5e6269652956b640870973157b27 columnFamilyName cf 2023-09-28 09:01:33,248 INFO [StoreOpener-d70a5e6269652956b640870973157b27-1] regionserver.HStore(310): Store=d70a5e6269652956b640870973157b27/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 09:01:33,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemState/d70a5e6269652956b640870973157b27 2023-09-28 09:01:33,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fe479ee53526382623d9b6dd95f6b0b6 2023-09-28 09:01:33,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemState/d70a5e6269652956b640870973157b27 2023-09-28 09:01:33,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemState/fe479ee53526382623d9b6dd95f6b0b6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 09:01:33,253 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fe479ee53526382623d9b6dd95f6b0b6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72552203, jitterRate=0.08111207187175751}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 09:01:33,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fe479ee53526382623d9b6dd95f6b0b6: 2023-09-28 09:01:33,254 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1695891692839.fe479ee53526382623d9b6dd95f6b0b6., pid=30, masterSystemTime=1695891693227 2023-09-28 09:01:33,254 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d70a5e6269652956b640870973157b27 2023-09-28 09:01:33,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1695891692839.fe479ee53526382623d9b6dd95f6b0b6. 2023-09-28 09:01:33,256 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1695891692839.fe479ee53526382623d9b6dd95f6b0b6. 2023-09-28 09:01:33,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemState/d70a5e6269652956b640870973157b27/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 09:01:33,257 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d70a5e6269652956b640870973157b27; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62467764, jitterRate=-0.06915777921676636}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 09:01:33,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d70a5e6269652956b640870973157b27: 2023-09-28 09:01:33,257 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=fe479ee53526382623d9b6dd95f6b0b6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:33,258 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1695891692839.fe479ee53526382623d9b6dd95f6b0b6.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695891693257"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695891693257"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695891693257"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695891693257"}]},"ts":"1695891693257"} 2023-09-28 09:01:33,258 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1695891692839.d70a5e6269652956b640870973157b27., pid=31, masterSystemTime=1695891693230 2023-09-28 09:01:33,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1695891692839.d70a5e6269652956b640870973157b27. 2023-09-28 09:01:33,264 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1695891692839.d70a5e6269652956b640870973157b27. 2023-09-28 09:01:33,264 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=d70a5e6269652956b640870973157b27, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:33,265 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1695891692839.d70a5e6269652956b640870973157b27.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695891693264"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695891693264"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695891693264"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695891693264"}]},"ts":"1695891693264"} 2023-09-28 09:01:33,266 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=29 2023-09-28 09:01:33,267 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure fe479ee53526382623d9b6dd95f6b0b6, server=jenkins-hbase4.apache.org,40311,1695891668959 in 188 msec 2023-09-28 09:01:33,269 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fe479ee53526382623d9b6dd95f6b0b6, ASSIGN in 352 msec 2023-09-28 09:01:33,271 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=28 2023-09-28 09:01:33,271 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure d70a5e6269652956b640870973157b27, server=jenkins-hbase4.apache.org,40045,1695891669000 in 192 msec 2023-09-28 09:01:33,273 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=28, resume processing ppid=27 2023-09-28 09:01:33,273 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d70a5e6269652956b640870973157b27, ASSIGN in 356 msec 2023-09-28 09:01:33,274 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-28 09:01:33,274 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695891693274"}]},"ts":"1695891693274"} 2023-09-28 09:01:33,276 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-09-28 09:01:33,279 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-28 09:01:33,279 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-09-28 09:01:33,281 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40311] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-28 09:01:33,283 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 09:01:33,283 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 09:01:33,283 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 09:01:33,283 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 09:01:33,284 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-28 09:01:33,284 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-28 09:01:33,285 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-28 09:01:33,285 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-28 09:01:33,286 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 443 msec 2023-09-28 09:01:33,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-28 09:01:33,451 INFO [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-09-28 09:01:33,454 DEBUG [Listener at jenkins-hbase4.apache.org/39071] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-28 09:01:33,454 DEBUG [Listener at jenkins-hbase4.apache.org/39071] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695891692839.d70a5e6269652956b640870973157b27. 2023-09-28 09:01:33,456 INFO [Listener at jenkins-hbase4.apache.org/39071] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-28 09:01:33,466 DEBUG [hconnection-0x1efc3b9f-shared-pool-10] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 09:01:33,471 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33236, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 09:01:33,477 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-28 09:01:33,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695891693478 (current time:1695891693478). 2023-09-28 09:01:33,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-28 09:01:33,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] zookeeper.ReadOnlyZKClient(139): Connect 0x1e9e1eb4 to 127.0.0.1:61959 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 09:01:33,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@50e10819, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 09:01:33,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 09:01:33,494 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42216, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 09:01:33,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1e9e1eb4 to 127.0.0.1:61959 2023-09-28 09:01:33,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 09:01:33,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] zookeeper.ReadOnlyZKClient(139): Connect 0x3de47b1a to 127.0.0.1:61959 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 09:01:33,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5361b9ac, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 09:01:33,504 DEBUG [hconnection-0xb18d219-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 09:01:33,505 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42232, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 09:01:33,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3de47b1a to 127.0.0.1:61959 2023-09-28 09:01:33,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 09:01:33,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-28 09:01:33,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-28 09:01:33,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-28 09:01:33,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-28 09:01:33,515 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-28 09:01:33,516 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695892293516 2023-09-28 09:01:33,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-28 09:01:33,516 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-28 09:01:33,518 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-28 09:01:33,518 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-28 09:01:33,519 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-28 09:01:33,520 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-28 09:01:33,521 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-09-28 09:01:33,522 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-28 09:01:33,523 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695892293523 2023-09-28 09:01:33,541 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,542 INFO [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-09-28 09:01:33,542 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 09:01:33,544 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-09-28 09:01:33,544 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-28 09:01:33,544 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,544 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,550 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:01:33,550 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:33,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:01:33,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:01:33,550 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:01:33,550 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:01:33,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:01:33,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:01:33,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:01:33,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:01:33,551 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:33,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,551 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:33,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,551 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,551 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:33,551 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-28 09:01:33,551 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,551 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-28 09:01:33,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-28 09:01:33,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-28 09:01:33,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,552 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-28 09:01:33,552 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-28 09:01:33,552 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-28 09:01:33,552 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,552 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,552 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-28 09:01:33,552 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-28 09:01:33,552 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 09:01:33,552 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 09:01:33,552 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,555 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-28 09:01:33,555 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-28 09:01:33,555 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 09:01:33,555 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-28 09:01:33,555 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-28 09:01:33,556 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-28 09:01:33,556 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40311,1695891668959' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-28 09:01:33,554 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-28 09:01:33,555 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40045,1695891669000' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-28 09:01:33,556 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-28 09:01:33,556 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39195,1695891668910' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-28 09:01:33,562 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,562 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:33,562 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,562 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:33,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:01:33,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:01:33,562 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:33,562 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,562 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 09:01:33,562 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:01:33,562 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 09:01:33,562 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,563 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 09:01:33,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:01:33,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:33,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:33,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:33,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:01:33,565 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40045,1695891669000' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-28 09:01:33,565 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@357824c1[Count = 1] remaining members to acquire global barrier 2023-09-28 09:01:33,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:33,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:01:33,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:01:33,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:01:33,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:01:33,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:33,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:33,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:33,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:01:33,567 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40311,1695891668959' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-28 09:01:33,567 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@357824c1[Count = 0] remaining members to acquire global barrier 2023-09-28 09:01:33,567 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-28 09:01:33,567 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,569 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,569 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,569 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,569 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-28 09:01:33,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,569 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:33,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,569 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 09:01:33,569 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-28 09:01:33,569 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695891692839.fe479ee53526382623d9b6dd95f6b0b6. 2023-09-28 09:01:33,569 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-28 09:01:33,569 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695891692839.fe479ee53526382623d9b6dd95f6b0b6. started... 2023-09-28 09:01:33,569 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:33,569 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-28 09:01:33,569 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 09:01:33,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,571 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fe479ee53526382623d9b6dd95f6b0b6: 2023-09-28 09:01:33,571 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-28 09:01:33,569 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39195,1695891668910' in zk 2023-09-28 09:01:33,571 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695891692839.fe479ee53526382623d9b6dd95f6b0b6.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,571 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 09:01:33,571 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 09:01:33,571 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695891692839.d70a5e6269652956b640870973157b27. 2023-09-28 09:01:33,571 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-28 09:01:33,571 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695891692839.d70a5e6269652956b640870973157b27. started... 2023-09-28 09:01:33,571 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 09:01:33,571 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d70a5e6269652956b640870973157b27: 2023-09-28 09:01:33,572 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695891692839.d70a5e6269652956b640870973157b27.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,572 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 09:01:33,572 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-28 09:01:33,573 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-28 09:01:33,573 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 09:01:33,573 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-28 09:01:33,587 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695891692839.fe479ee53526382623d9b6dd95f6b0b6. completed. 2023-09-28 09:01:33,587 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695891692839.fe479ee53526382623d9b6dd95f6b0b6. 2023-09-28 09:01:33,587 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 09:01:33,587 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 09:01:33,587 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:33,587 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-28 09:01:33,587 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40311,1695891668959' in zk 2023-09-28 09:01:33,587 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695891692839.d70a5e6269652956b640870973157b27. completed. 2023-09-28 09:01:33,587 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695891692839.d70a5e6269652956b640870973157b27. 2023-09-28 09:01:33,587 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 09:01:33,587 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 09:01:33,588 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:33,588 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-28 09:01:33,588 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40045,1695891669000' in zk 2023-09-28 09:01:33,589 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-28 09:01:33,589 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:33,589 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 09:01:33,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:33,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:01:33,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:01:33,589 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-28 09:01:33,592 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:33,592 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-28 09:01:33,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:01:33,592 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 09:01:33,592 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-28 09:01:33,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:01:33,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:33,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:33,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:33,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:01:33,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:33,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:33,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:33,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,40311,1695891668959': 2023-09-28 09:01:33,596 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40311,1695891668959' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-28 09:01:33,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:33,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:01:33,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:01:33,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:01:33,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:01:33,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:33,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:33,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:33,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:01:33,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:33,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:33,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:33,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,40045,1695891669000': 2023-09-28 09:01:33,602 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40045,1695891669000' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-28 09:01:33,602 INFO [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-09-28 09:01:33,602 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-28 09:01:33,602 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-28 09:01:33,602 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,602 INFO [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-28 09:01:33,603 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,603 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,603 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:01:33,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,603 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,603 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,604 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:01:33,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,604 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:01:33,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:01:33,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:01:33,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:01:33,604 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:33,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:01:33,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:01:33,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:01:33,605 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:33,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:01:33,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:01:33,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:01:33,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,605 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:33,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:01:33,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:33,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:33,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:33,607 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:33,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:01:33,608 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:33,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,608 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:33,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:33,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:33,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:33,611 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:33,611 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:01:33,611 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:01:33,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:01:33,611 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:01:33,611 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,611 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:01:33,612 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 09:01:33,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:01:33,611 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:01:33,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:01:33,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:01:33,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:01:33,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:01:33,613 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:01:33,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:01:33,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:01:33,612 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,612 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:33,614 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:33,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:01:33,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:01:33,613 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-28 09:01:33,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:01:33,614 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,614 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-28 09:01:33,614 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:01:33,614 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:33,615 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,615 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:33,615 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:33,615 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,615 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,615 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-28 09:01:33,618 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 09:01:33,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-28 09:01:33,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-28 09:01:33,619 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-28 09:01:33,623 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,624 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,645 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,646 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-28 09:01:33,646 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,646 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:33,646 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695891693517Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695891693623 (+106 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1695891693623Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1695891693624 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemState at 1695891693628 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1695891693638 (+10 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695891693646 (+8 ms) 2023-09-28 09:01:33,649 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-28 09:01:33,653 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 131 msec 2023-09-28 09:01:33,820 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 09:01:33,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-28 09:01:33,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-28 09:01:33,828 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40045] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1695891692839.d70a5e6269652956b640870973157b27. with WAL disabled. Data may be lost in the event of a crash. 2023-09-28 09:01:33,830 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1695891692839.fe479ee53526382623d9b6dd95f6b0b6. with WAL disabled. Data may be lost in the event of a crash. 2023-09-28 09:01:33,834 DEBUG [Listener at jenkins-hbase4.apache.org/39071] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-28 09:01:33,834 DEBUG [Listener at jenkins-hbase4.apache.org/39071] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695891692839.d70a5e6269652956b640870973157b27. 2023-09-28 09:01:33,834 INFO [Listener at jenkins-hbase4.apache.org/39071] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-28 09:01:33,847 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-28 09:01:33,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695891693847 (current time:1695891693847). 2023-09-28 09:01:33,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-28 09:01:33,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] zookeeper.ReadOnlyZKClient(139): Connect 0x4bd18b2c to 127.0.0.1:61959 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 09:01:33,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2a3301bb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 09:01:33,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 09:01:33,861 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42242, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 09:01:33,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4bd18b2c to 127.0.0.1:61959 2023-09-28 09:01:33,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 09:01:33,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] zookeeper.ReadOnlyZKClient(139): Connect 0x677fbb92 to 127.0.0.1:61959 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 09:01:33,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12bc37ce, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 09:01:33,871 DEBUG [hconnection-0x47a207de-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 09:01:33,874 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42256, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 09:01:33,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x677fbb92 to 127.0.0.1:61959 2023-09-28 09:01:33,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 09:01:33,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-28 09:01:33,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-28 09:01:33,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-28 09:01:33,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-28 09:01:33,884 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-28 09:01:33,885 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695892293885 2023-09-28 09:01:33,885 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-28 09:01:33,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-28 09:01:33,886 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-28 09:01:33,887 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-28 09:01:33,888 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-28 09:01:33,888 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-28 09:01:33,889 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-09-28 09:01:33,890 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-28 09:01:33,891 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695892293891 2023-09-28 09:01:33,906 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-09-28 09:01:33,907 INFO [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-09-28 09:01:33,907 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 09:01:33,908 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-09-28 09:01:33,909 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-28 09:01:33,909 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 09:01:33,909 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-28 09:01:33,911 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:01:33,911 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:01:33,911 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:01:33,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:01:33,911 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:33,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:01:33,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:01:33,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:01:33,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:01:33,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:01:33,911 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:33,911 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:33,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-28 09:01:33,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-28 09:01:33,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-28 09:01:33,912 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:33,912 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-28 09:01:33,912 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 09:01:33,912 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 09:01:33,912 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 09:01:33,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-28 09:01:33,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-28 09:01:33,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-28 09:01:33,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-28 09:01:33,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-28 09:01:33,913 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-28 09:01:33,913 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-28 09:01:33,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-28 09:01:33,913 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-28 09:01:33,913 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-28 09:01:33,913 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-28 09:01:33,913 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-28 09:01:33,913 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-28 09:01:33,913 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 09:01:33,913 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-28 09:01:33,915 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-28 09:01:33,913 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-28 09:01:33,915 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-28 09:01:33,915 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 09:01:33,915 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40045,1695891669000' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-28 09:01:33,915 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 09:01:33,916 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-28 09:01:33,916 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-28 09:01:33,916 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39195,1695891668910' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-28 09:01:33,917 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-28 09:01:33,917 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-28 09:01:33,917 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40311,1695891668959' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-28 09:01:33,920 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:33,920 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 09:01:33,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:33,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:01:33,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:01:33,921 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 09:01:33,921 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 09:01:33,921 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:33,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:01:33,921 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 09:01:33,922 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 09:01:33,922 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 09:01:33,922 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 09:01:33,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:01:33,922 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 09:01:33,922 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 09:01:33,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-28 09:01:33,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:33,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:33,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:33,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:01:33,924 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40045,1695891669000' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-28 09:01:33,924 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e46c8d[Count = 1] remaining members to acquire global barrier 2023-09-28 09:01:33,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:33,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:01:33,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:01:33,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:01:33,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:01:33,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-28 09:01:33,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:33,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:33,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:33,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:01:33,927 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40311,1695891668959' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-28 09:01:33,927 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e46c8d[Count = 0] remaining members to acquire global barrier 2023-09-28 09:01:33,927 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-28 09:01:33,927 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 09:01:33,928 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 09:01:33,928 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 09:01:33,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 09:01:33,928 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 09:01:33,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 09:01:33,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 09:01:33,928 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-28 09:01:33,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 09:01:33,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 09:01:33,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 09:01:33,929 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 09:01:33,929 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-28 09:01:33,929 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695891692839.fe479ee53526382623d9b6dd95f6b0b6. 2023-09-28 09:01:33,929 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 09:01:33,929 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695891692839.fe479ee53526382623d9b6dd95f6b0b6. started... 2023-09-28 09:01:33,929 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 09:01:33,929 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 09:01:33,929 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-28 09:01:33,929 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-28 09:01:33,929 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39195,1695891668910' in zk 2023-09-28 09:01:33,929 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:33,929 INFO [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] regionserver.HRegion(2745): Flushing fe479ee53526382623d9b6dd95f6b0b6 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-09-28 09:01:33,929 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695891692839.d70a5e6269652956b640870973157b27. 2023-09-28 09:01:33,929 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695891692839.d70a5e6269652956b640870973157b27. started... 2023-09-28 09:01:33,930 INFO [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d70a5e6269652956b640870973157b27 1/1 column families, dataSize=132 B heapSize=544 B 2023-09-28 09:01:33,930 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:33,930 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-28 09:01:33,931 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-28 09:01:33,931 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 09:01:33,931 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-28 09:01:33,959 INFO [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023092895ace8ee3b034a86b44e748f42d97e00 to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023092895ace8ee3b034a86b44e748f42d97e00 2023-09-28 09:01:33,959 INFO [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023092838a10a35be9b415fb9a083ce05b78aa2 to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023092838a10a35be9b415fb9a083ce05b78aa2 2023-09-28 09:01:33,990 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 09:01:33,991 INFO [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemState/fe479ee53526382623d9b6dd95f6b0b6/.tmp/cf/7527497321d441039282366450001f49 2023-09-28 09:01:33,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-28 09:01:33,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-28 09:01:33,992 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-28 09:01:33,993 INFO [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemState/d70a5e6269652956b640870973157b27/.tmp/cf/ae816031844849839d946c22525cb9a9 2023-09-28 09:01:33,999 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemState/d70a5e6269652956b640870973157b27/.tmp/cf/ae816031844849839d946c22525cb9a9 as hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemState/d70a5e6269652956b640870973157b27/cf/ae816031844849839d946c22525cb9a9 2023-09-28 09:01:33,999 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemState/fe479ee53526382623d9b6dd95f6b0b6/.tmp/cf/7527497321d441039282366450001f49 as hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemState/fe479ee53526382623d9b6dd95f6b0b6/cf/7527497321d441039282366450001f49 2023-09-28 09:01:34,006 INFO [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemState/d70a5e6269652956b640870973157b27/cf/ae816031844849839d946c22525cb9a9, entries=2, sequenceid=6, filesize=5.2 K 2023-09-28 09:01:34,007 INFO [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemState/fe479ee53526382623d9b6dd95f6b0b6/cf/7527497321d441039282366450001f49, entries=48, sequenceid=6, filesize=13.0 K 2023-09-28 09:01:34,007 INFO [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for d70a5e6269652956b640870973157b27 in 77ms, sequenceid=6, compaction requested=false 2023-09-28 09:01:34,007 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-09-28 09:01:34,008 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d70a5e6269652956b640870973157b27: 2023-09-28 09:01:34,008 INFO [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for fe479ee53526382623d9b6dd95f6b0b6 in 79ms, sequenceid=6, compaction requested=false 2023-09-28 09:01:34,009 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fe479ee53526382623d9b6dd95f6b0b6: 2023-09-28 09:01:34,009 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695891692839.d70a5e6269652956b640870973157b27.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-28 09:01:34,009 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 09:01:34,009 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695891692839.fe479ee53526382623d9b6dd95f6b0b6.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-28 09:01:34,009 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemState/d70a5e6269652956b640870973157b27/cf/ae816031844849839d946c22525cb9a9] hfiles 2023-09-28 09:01:34,010 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 09:01:34,010 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemState/d70a5e6269652956b640870973157b27/cf/ae816031844849839d946c22525cb9a9 for snapshot=snaptb0-testExportFileSystemState 2023-09-28 09:01:34,010 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemState/fe479ee53526382623d9b6dd95f6b0b6/cf/7527497321d441039282366450001f49] hfiles 2023-09-28 09:01:34,010 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemState/fe479ee53526382623d9b6dd95f6b0b6/cf/7527497321d441039282366450001f49 for snapshot=snaptb0-testExportFileSystemState 2023-09-28 09:01:34,024 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695891692839.d70a5e6269652956b640870973157b27. completed. 2023-09-28 09:01:34,024 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695891692839.d70a5e6269652956b640870973157b27. 2023-09-28 09:01:34,024 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 09:01:34,024 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695891692839.fe479ee53526382623d9b6dd95f6b0b6. completed. 2023-09-28 09:01:34,024 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695891692839.fe479ee53526382623d9b6dd95f6b0b6. 2023-09-28 09:01:34,024 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 09:01:34,024 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:34,024 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 09:01:34,024 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-28 09:01:34,024 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 09:01:34,024 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:34,024 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40045,1695891669000' in zk 2023-09-28 09:01:34,024 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-28 09:01:34,025 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40311,1695891668959' in zk 2023-09-28 09:01:34,030 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:34,030 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-28 09:01:34,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:34,030 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 09:01:34,030 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-28 09:01:34,030 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-28 09:01:34,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:01:34,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:01:34,030 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:34,030 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 09:01:34,032 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-28 09:01:34,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:01:34,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:01:34,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-28 09:01:34,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:34,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:34,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:34,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:01:34,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-28 09:01:34,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:34,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:34,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:34,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,40045,1695891669000': 2023-09-28 09:01:34,037 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40045,1695891669000' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-28 09:01:34,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:34,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:01:34,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:01:34,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:01:34,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:01:34,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-28 09:01:34,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:34,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:34,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:34,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:01:34,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-28 09:01:34,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:34,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:34,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:34,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,40311,1695891668959': 2023-09-28 09:01:34,041 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40311,1695891668959' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-28 09:01:34,041 INFO [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-09-28 09:01:34,041 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-28 09:01:34,042 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-28 09:01:34,042 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-09-28 09:01:34,042 INFO [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-28 09:01:34,044 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 09:01:34,044 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 09:01:34,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 09:01:34,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 09:01:34,044 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 09:01:34,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 09:01:34,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 09:01:34,044 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:01:34,044 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 09:01:34,044 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:01:34,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 09:01:34,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:01:34,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:01:34,044 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:01:34,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:01:34,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 09:01:34,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:01:34,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:01:34,045 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:34,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:01:34,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 09:01:34,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 09:01:34,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:01:34,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 09:01:34,045 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:34,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:01:34,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:01:34,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 09:01:34,046 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:34,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-28 09:01:34,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:01:34,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-28 09:01:34,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:34,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:34,048 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:34,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:34,048 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:34,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:01:34,049 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:34,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-28 09:01:34,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:34,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:34,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:34,052 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:34,052 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:01:34,052 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-28 09:01:34,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:01:34,053 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:01:34,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:01:34,053 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:34,053 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:01:34,053 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:01:34,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:01:34,053 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 09:01:34,053 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:01:34,053 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-09-28 09:01:34,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:01:34,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:01:34,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:01:34,053 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:01:34,053 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:34,055 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-28 09:01:34,055 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:34,055 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 09:01:34,055 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:34,055 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:34,055 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 09:01:34,055 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 09:01:34,055 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-28 09:01:34,055 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-28 09:01:34,055 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-28 09:01:34,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:01:34,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:01:34,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:01:34,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:01:34,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:01:34,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:01:34,056 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023092838a10a35be9b415fb9a083ce05b78aa2, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023092895ace8ee3b034a86b44e748f42d97e00] mob files 2023-09-28 09:01:34,057 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023092838a10a35be9b415fb9a083ce05b78aa2 2023-09-28 09:01:34,057 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023092895ace8ee3b034a86b44e748f42d97e00 2023-09-28 09:01:34,069 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-09-28 09:01:34,070 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-28 09:01:34,094 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-28 09:01:34,095 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-28 09:01:34,095 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-28 09:01:34,095 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-28 09:01:34,095 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695891693885Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695891694069 (+184 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1695891694069Loading Region manifests for snaptb0-testExportFileSystemState at 1695891694069Writing data manifest for snaptb0-testExportFileSystemState at 1695891694074 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1695891694085 (+11 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695891694095 (+10 ms) 2023-09-28 09:01:34,098 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-28 09:01:34,101 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 212 msec 2023-09-28 09:01:34,192 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 09:01:34,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-28 09:01:34,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-28 09:01:34,194 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/export-test/export-1695891694194 2023-09-28 09:01:34,194 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:39781, tgtDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/export-test/export-1695891694194, rawTgtDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/export-test/export-1695891694194, srcFsUri=hdfs://localhost:39781, srcDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba 2023-09-28 09:01:34,221 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39781, inputRoot=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba 2023-09-28 09:01:34,221 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-134816062_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/export-test/export-1695891694194, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/export-test/export-1695891694194/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-28 09:01:34,221 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39781, inputRoot=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba, snapshotDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-09-28 09:01:34,236 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/export-test/export-1695891694194/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-28 09:01:34,270 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-28 09:01:34,270 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-28 09:01:34,271 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-28 09:01:34,271 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-28 09:01:35,185 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/hadoop-4254406358017024384.jar 2023-09-28 09:01:35,186 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-28 09:01:35,186 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-28 09:01:35,254 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/hadoop-8088269874938944429.jar 2023-09-28 09:01:35,254 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-28 09:01:35,255 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-28 09:01:35,255 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-28 09:01:35,256 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-28 09:01:35,256 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-28 09:01:35,256 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-28 09:01:35,257 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-28 09:01:35,257 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-28 09:01:35,258 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-28 09:01:35,258 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-28 09:01:35,258 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-28 09:01:35,259 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-28 09:01:35,259 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-28 09:01:35,260 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-28 09:01:35,260 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-28 09:01:35,261 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-28 09:01:35,261 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 09:01:35,262 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 09:01:35,262 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 09:01:35,263 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 09:01:35,263 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 09:01:35,263 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 09:01:35,264 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 09:01:35,741 WARN [Listener at jenkins-hbase4.apache.org/39071] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-28 09:01:35,744 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-09-28 09:01:35,746 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-28 09:01:36,871 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 09:01:36,872 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 09:01:36,878 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695891675416_0001_000001 (auth:SIMPLE) 2023-09-28 09:01:37,499 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695891675416_0002_000001 (auth:SIMPLE) 2023-09-28 09:01:38,116 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-28 09:01:41,676 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695891675416_0002_000001 (auth:SIMPLE) 2023-09-28 09:01:43,918 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695891675416_0002_000001 (auth:SIMPLE) 2023-09-28 09:01:47,171 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695891675416_0002_000001 (auth:SIMPLE) 2023-09-28 09:01:48,948 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-28 09:01:48,949 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-28 09:01:48,957 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-09-28 09:01:48,957 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-28 09:01:48,957 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-28 09:01:48,957 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1698010877_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-28 09:01:48,958 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(367): hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-28 09:01:48,958 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(367): hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-28 09:01:48,958 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1698010877_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/export-test/export-1695891694194/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/export-test/export-1695891694194/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-28 09:01:48,958 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(367): hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/export-test/export-1695891694194/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-28 09:01:48,959 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(367): hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/export-test/export-1695891694194/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-28 09:01:48,966 INFO [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-09-28 09:01:48,966 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-09-28 09:01:48,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-09-28 09:01:48,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-28 09:01:48,972 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695891708971"}]},"ts":"1695891708971"} 2023-09-28 09:01:48,973 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-09-28 09:01:48,975 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-09-28 09:01:48,976 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d70a5e6269652956b640870973157b27, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fe479ee53526382623d9b6dd95f6b0b6, UNASSIGN}] 2023-09-28 09:01:48,978 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d70a5e6269652956b640870973157b27, UNASSIGN 2023-09-28 09:01:48,978 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fe479ee53526382623d9b6dd95f6b0b6, UNASSIGN 2023-09-28 09:01:48,979 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=d70a5e6269652956b640870973157b27, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:48,979 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=fe479ee53526382623d9b6dd95f6b0b6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:48,979 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695891692839.d70a5e6269652956b640870973157b27.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695891708979"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695891708979"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695891708979"}]},"ts":"1695891708979"} 2023-09-28 09:01:48,979 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695891692839.fe479ee53526382623d9b6dd95f6b0b6.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695891708979"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695891708979"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695891708979"}]},"ts":"1695891708979"} 2023-09-28 09:01:48,981 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure d70a5e6269652956b640870973157b27, server=jenkins-hbase4.apache.org,40045,1695891669000}] 2023-09-28 09:01:48,982 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure fe479ee53526382623d9b6dd95f6b0b6, server=jenkins-hbase4.apache.org,40311,1695891668959}] 2023-09-28 09:01:49,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-28 09:01:49,133 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d70a5e6269652956b640870973157b27 2023-09-28 09:01:49,134 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d70a5e6269652956b640870973157b27, disabling compactions & flushes 2023-09-28 09:01:49,134 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695891692839.d70a5e6269652956b640870973157b27. 2023-09-28 09:01:49,134 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695891692839.d70a5e6269652956b640870973157b27. 2023-09-28 09:01:49,134 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695891692839.d70a5e6269652956b640870973157b27. after waiting 0 ms 2023-09-28 09:01:49,134 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695891692839.d70a5e6269652956b640870973157b27. 2023-09-28 09:01:49,134 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close fe479ee53526382623d9b6dd95f6b0b6 2023-09-28 09:01:49,134 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fe479ee53526382623d9b6dd95f6b0b6, disabling compactions & flushes 2023-09-28 09:01:49,134 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695891692839.fe479ee53526382623d9b6dd95f6b0b6. 2023-09-28 09:01:49,134 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695891692839.fe479ee53526382623d9b6dd95f6b0b6. 2023-09-28 09:01:49,134 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695891692839.fe479ee53526382623d9b6dd95f6b0b6. after waiting 0 ms 2023-09-28 09:01:49,134 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695891692839.fe479ee53526382623d9b6dd95f6b0b6. 2023-09-28 09:01:49,144 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemState/d70a5e6269652956b640870973157b27/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-28 09:01:49,144 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemState/fe479ee53526382623d9b6dd95f6b0b6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-28 09:01:49,144 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 09:01:49,144 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 09:01:49,145 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695891692839.d70a5e6269652956b640870973157b27. 2023-09-28 09:01:49,146 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d70a5e6269652956b640870973157b27: 2023-09-28 09:01:49,146 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695891692839.fe479ee53526382623d9b6dd95f6b0b6. 2023-09-28 09:01:49,146 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fe479ee53526382623d9b6dd95f6b0b6: 2023-09-28 09:01:49,147 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d70a5e6269652956b640870973157b27 2023-09-28 09:01:49,148 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=d70a5e6269652956b640870973157b27, regionState=CLOSED 2023-09-28 09:01:49,148 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed fe479ee53526382623d9b6dd95f6b0b6 2023-09-28 09:01:49,148 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695891692839.d70a5e6269652956b640870973157b27.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695891709148"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695891709148"}]},"ts":"1695891709148"} 2023-09-28 09:01:49,149 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=fe479ee53526382623d9b6dd95f6b0b6, regionState=CLOSED 2023-09-28 09:01:49,149 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695891692839.fe479ee53526382623d9b6dd95f6b0b6.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695891709149"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695891709149"}]},"ts":"1695891709149"} 2023-09-28 09:01:49,152 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=37 2023-09-28 09:01:49,152 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure d70a5e6269652956b640870973157b27, server=jenkins-hbase4.apache.org,40045,1695891669000 in 169 msec 2023-09-28 09:01:49,153 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=38 2023-09-28 09:01:49,153 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure fe479ee53526382623d9b6dd95f6b0b6, server=jenkins-hbase4.apache.org,40311,1695891668959 in 169 msec 2023-09-28 09:01:49,154 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d70a5e6269652956b640870973157b27, UNASSIGN in 176 msec 2023-09-28 09:01:49,155 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=38, resume processing ppid=36 2023-09-28 09:01:49,155 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fe479ee53526382623d9b6dd95f6b0b6, UNASSIGN in 177 msec 2023-09-28 09:01:49,156 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695891709155"}]},"ts":"1695891709155"} 2023-09-28 09:01:49,157 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-09-28 09:01:49,158 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-09-28 09:01:49,160 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 193 msec 2023-09-28 09:01:49,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-28 09:01:49,274 INFO [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-09-28 09:01:49,274 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-09-28 09:01:49,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-28 09:01:49,278 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-28 09:01:49,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-09-28 09:01:49,280 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-28 09:01:49,281 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40311] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-09-28 09:01:49,285 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-28 09:01:49,285 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-28 09:01:49,285 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemState/d70a5e6269652956b640870973157b27 2023-09-28 09:01:49,285 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-28 09:01:49,285 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-28 09:01:49,285 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemState/fe479ee53526382623d9b6dd95f6b0b6 2023-09-28 09:01:49,285 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-28 09:01:49,286 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-28 09:01:49,286 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-28 09:01:49,286 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-28 09:01:49,287 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-28 09:01:49,287 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 09:01:49,287 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-28 09:01:49,287 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-28 09:01:49,287 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 09:01:49,287 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemState/d70a5e6269652956b640870973157b27/cf, FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemState/d70a5e6269652956b640870973157b27/recovered.edits] 2023-09-28 09:01:49,287 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 09:01:49,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-28 09:01:49,289 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-28 09:01:49,289 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemState/fe479ee53526382623d9b6dd95f6b0b6/cf, FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemState/fe479ee53526382623d9b6dd95f6b0b6/recovered.edits] 2023-09-28 09:01:49,289 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 09:01:49,293 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemState/d70a5e6269652956b640870973157b27/cf/ae816031844849839d946c22525cb9a9 to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/archive/data/default/testtb-testExportFileSystemState/d70a5e6269652956b640870973157b27/cf/ae816031844849839d946c22525cb9a9 2023-09-28 09:01:49,294 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemState/fe479ee53526382623d9b6dd95f6b0b6/cf/7527497321d441039282366450001f49 to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/archive/data/default/testtb-testExportFileSystemState/fe479ee53526382623d9b6dd95f6b0b6/cf/7527497321d441039282366450001f49 2023-09-28 09:01:49,297 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemState/d70a5e6269652956b640870973157b27/recovered.edits/9.seqid to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/archive/data/default/testtb-testExportFileSystemState/d70a5e6269652956b640870973157b27/recovered.edits/9.seqid 2023-09-28 09:01:49,298 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemState/d70a5e6269652956b640870973157b27 2023-09-28 09:01:49,298 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemState/fe479ee53526382623d9b6dd95f6b0b6/recovered.edits/9.seqid to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/archive/data/default/testtb-testExportFileSystemState/fe479ee53526382623d9b6dd95f6b0b6/recovered.edits/9.seqid 2023-09-28 09:01:49,299 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemState/fe479ee53526382623d9b6dd95f6b0b6 2023-09-28 09:01:49,299 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-28 09:01:49,299 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-28 09:01:49,300 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-09-28 09:01:49,305 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023092838a10a35be9b415fb9a083ce05b78aa2 to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023092838a10a35be9b415fb9a083ce05b78aa2 2023-09-28 09:01:49,306 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023092895ace8ee3b034a86b44e748f42d97e00 to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023092895ace8ee3b034a86b44e748f42d97e00 2023-09-28 09:01:49,307 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-28 09:01:49,310 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-28 09:01:49,313 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-09-28 09:01:49,315 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-09-28 09:01:49,316 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-28 09:01:49,316 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-09-28 09:01:49,317 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1695891692839.d70a5e6269652956b640870973157b27.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695891709316"}]},"ts":"9223372036854775807"} 2023-09-28 09:01:49,317 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1695891692839.fe479ee53526382623d9b6dd95f6b0b6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695891709316"}]},"ts":"9223372036854775807"} 2023-09-28 09:01:49,319 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-28 09:01:49,319 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d70a5e6269652956b640870973157b27, NAME => 'testtb-testExportFileSystemState,,1695891692839.d70a5e6269652956b640870973157b27.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => fe479ee53526382623d9b6dd95f6b0b6, NAME => 'testtb-testExportFileSystemState,1,1695891692839.fe479ee53526382623d9b6dd95f6b0b6.', STARTKEY => '1', ENDKEY => ''}] 2023-09-28 09:01:49,319 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-09-28 09:01:49,319 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695891709319"}]},"ts":"9223372036854775807"} 2023-09-28 09:01:49,321 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-09-28 09:01:49,323 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-28 09:01:49,325 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 48 msec 2023-09-28 09:01:49,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-28 09:01:49,390 INFO [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-09-28 09:01:49,398 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-09-28 09:01:49,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-09-28 09:01:49,402 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-09-28 09:01:49,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-09-28 09:01:49,429 INFO [Listener at jenkins-hbase4.apache.org/39071] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=765 (was 755) Potentially hanging thread: hconnection-0x3ff53656-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-134816062_17 at /127.0.0.1:45984 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1964 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (32912118) connection to jenkins-hbase4.apache.org/172.31.14.131:38885 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x3ff53656-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1203721210_1 at /127.0.0.1:42430 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1203721210_1 at /127.0.0.1:45960 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1698010877_17 at /127.0.0.1:33722 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3ff53656-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3ff53656-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1698010877_17 at /127.0.0.1:42452 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=933 (was 922) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=197 (was 122) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 167) - ProcessCount LEAK? -, AvailableMemoryMB=4872 (was 5007) 2023-09-28 09:01:49,430 WARN [Listener at jenkins-hbase4.apache.org/39071] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-09-28 09:01:49,449 INFO [Listener at jenkins-hbase4.apache.org/39071] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=765, OpenFileDescriptor=933, MaxFileDescriptor=60000, SystemLoadAverage=197, ProcessCount=168, AvailableMemoryMB=4871 2023-09-28 09:01:49,450 WARN [Listener at jenkins-hbase4.apache.org/39071] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-09-28 09:01:49,451 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-28 09:01:49,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-09-28 09:01:49,456 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-09-28 09:01:49,456 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-09-28 09:01:49,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-28 09:01:49,457 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-28 09:01:49,460 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testConsecutiveExports/92adf1f436dd4aada125cde7ef956ff5 2023-09-28 09:01:49,460 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testConsecutiveExports/6dfa2f5692909504c51afa6837b0d4f8 2023-09-28 09:01:49,461 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testConsecutiveExports/92adf1f436dd4aada125cde7ef956ff5 empty. 2023-09-28 09:01:49,461 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testConsecutiveExports/6dfa2f5692909504c51afa6837b0d4f8 empty. 2023-09-28 09:01:49,461 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testConsecutiveExports/92adf1f436dd4aada125cde7ef956ff5 2023-09-28 09:01:49,461 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testConsecutiveExports/6dfa2f5692909504c51afa6837b0d4f8 2023-09-28 09:01:49,461 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-28 09:01:49,475 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-09-28 09:01:49,477 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 92adf1f436dd4aada125cde7ef956ff5, NAME => 'testtb-testConsecutiveExports,,1695891709451.92adf1f436dd4aada125cde7ef956ff5.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp 2023-09-28 09:01:49,477 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 6dfa2f5692909504c51afa6837b0d4f8, NAME => 'testtb-testConsecutiveExports,1,1695891709451.6dfa2f5692909504c51afa6837b0d4f8.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp 2023-09-28 09:01:49,488 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695891709451.92adf1f436dd4aada125cde7ef956ff5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 09:01:49,488 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 92adf1f436dd4aada125cde7ef956ff5, disabling compactions & flushes 2023-09-28 09:01:49,489 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695891709451.92adf1f436dd4aada125cde7ef956ff5. 2023-09-28 09:01:49,489 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695891709451.92adf1f436dd4aada125cde7ef956ff5. 2023-09-28 09:01:49,489 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695891709451.92adf1f436dd4aada125cde7ef956ff5. after waiting 0 ms 2023-09-28 09:01:49,489 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695891709451.92adf1f436dd4aada125cde7ef956ff5. 2023-09-28 09:01:49,489 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695891709451.92adf1f436dd4aada125cde7ef956ff5. 2023-09-28 09:01:49,489 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 92adf1f436dd4aada125cde7ef956ff5: 2023-09-28 09:01:49,489 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695891709451.6dfa2f5692909504c51afa6837b0d4f8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 09:01:49,489 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 6dfa2f5692909504c51afa6837b0d4f8, disabling compactions & flushes 2023-09-28 09:01:49,489 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695891709451.6dfa2f5692909504c51afa6837b0d4f8. 2023-09-28 09:01:49,489 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695891709451.6dfa2f5692909504c51afa6837b0d4f8. 2023-09-28 09:01:49,489 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695891709451.6dfa2f5692909504c51afa6837b0d4f8. after waiting 0 ms 2023-09-28 09:01:49,489 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695891709451.6dfa2f5692909504c51afa6837b0d4f8. 2023-09-28 09:01:49,489 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695891709451.6dfa2f5692909504c51afa6837b0d4f8. 2023-09-28 09:01:49,489 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 6dfa2f5692909504c51afa6837b0d4f8: 2023-09-28 09:01:49,494 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-09-28 09:01:49,495 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695891709451.92adf1f436dd4aada125cde7ef956ff5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695891709495"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695891709495"}]},"ts":"1695891709495"} 2023-09-28 09:01:49,495 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695891709451.6dfa2f5692909504c51afa6837b0d4f8.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695891709495"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695891709495"}]},"ts":"1695891709495"} 2023-09-28 09:01:49,497 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-28 09:01:49,498 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-28 09:01:49,498 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695891709498"}]},"ts":"1695891709498"} 2023-09-28 09:01:49,500 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-09-28 09:01:49,504 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-28 09:01:49,505 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-28 09:01:49,505 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-28 09:01:49,505 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-28 09:01:49,505 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-28 09:01:49,506 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=92adf1f436dd4aada125cde7ef956ff5, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6dfa2f5692909504c51afa6837b0d4f8, ASSIGN}] 2023-09-28 09:01:49,508 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6dfa2f5692909504c51afa6837b0d4f8, ASSIGN 2023-09-28 09:01:49,508 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=92adf1f436dd4aada125cde7ef956ff5, ASSIGN 2023-09-28 09:01:49,509 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6dfa2f5692909504c51afa6837b0d4f8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39195,1695891668910; forceNewPlan=false, retain=false 2023-09-28 09:01:49,509 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=92adf1f436dd4aada125cde7ef956ff5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40311,1695891668959; forceNewPlan=false, retain=false 2023-09-28 09:01:49,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-28 09:01:49,659 INFO [jenkins-hbase4:40293] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-28 09:01:49,662 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=92adf1f436dd4aada125cde7ef956ff5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:49,662 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=6dfa2f5692909504c51afa6837b0d4f8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:49,662 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695891709451.92adf1f436dd4aada125cde7ef956ff5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695891709662"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695891709662"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695891709662"}]},"ts":"1695891709662"} 2023-09-28 09:01:49,662 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695891709451.6dfa2f5692909504c51afa6837b0d4f8.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695891709662"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695891709662"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695891709662"}]},"ts":"1695891709662"} 2023-09-28 09:01:49,665 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 92adf1f436dd4aada125cde7ef956ff5, server=jenkins-hbase4.apache.org,40311,1695891668959}] 2023-09-28 09:01:49,665 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 6dfa2f5692909504c51afa6837b0d4f8, server=jenkins-hbase4.apache.org,39195,1695891668910}] 2023-09-28 09:01:49,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-28 09:01:49,820 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1695891709451.92adf1f436dd4aada125cde7ef956ff5. 2023-09-28 09:01:49,820 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1695891709451.6dfa2f5692909504c51afa6837b0d4f8. 2023-09-28 09:01:49,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 92adf1f436dd4aada125cde7ef956ff5, NAME => 'testtb-testConsecutiveExports,,1695891709451.92adf1f436dd4aada125cde7ef956ff5.', STARTKEY => '', ENDKEY => '1'} 2023-09-28 09:01:49,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6dfa2f5692909504c51afa6837b0d4f8, NAME => 'testtb-testConsecutiveExports,1,1695891709451.6dfa2f5692909504c51afa6837b0d4f8.', STARTKEY => '1', ENDKEY => ''} 2023-09-28 09:01:49,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1695891709451.92adf1f436dd4aada125cde7ef956ff5. service=AccessControlService 2023-09-28 09:01:49,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1695891709451.6dfa2f5692909504c51afa6837b0d4f8. service=AccessControlService 2023-09-28 09:01:49,821 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 09:01:49,821 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 09:01:49,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 6dfa2f5692909504c51afa6837b0d4f8 2023-09-28 09:01:49,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 92adf1f436dd4aada125cde7ef956ff5 2023-09-28 09:01:49,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695891709451.6dfa2f5692909504c51afa6837b0d4f8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 09:01:49,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695891709451.92adf1f436dd4aada125cde7ef956ff5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 09:01:49,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6dfa2f5692909504c51afa6837b0d4f8 2023-09-28 09:01:49,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 92adf1f436dd4aada125cde7ef956ff5 2023-09-28 09:01:49,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6dfa2f5692909504c51afa6837b0d4f8 2023-09-28 09:01:49,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 92adf1f436dd4aada125cde7ef956ff5 2023-09-28 09:01:49,823 INFO [StoreOpener-6dfa2f5692909504c51afa6837b0d4f8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6dfa2f5692909504c51afa6837b0d4f8 2023-09-28 09:01:49,823 INFO [StoreOpener-92adf1f436dd4aada125cde7ef956ff5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 92adf1f436dd4aada125cde7ef956ff5 2023-09-28 09:01:49,824 DEBUG [StoreOpener-6dfa2f5692909504c51afa6837b0d4f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testConsecutiveExports/6dfa2f5692909504c51afa6837b0d4f8/cf 2023-09-28 09:01:49,824 DEBUG [StoreOpener-92adf1f436dd4aada125cde7ef956ff5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testConsecutiveExports/92adf1f436dd4aada125cde7ef956ff5/cf 2023-09-28 09:01:49,824 DEBUG [StoreOpener-6dfa2f5692909504c51afa6837b0d4f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testConsecutiveExports/6dfa2f5692909504c51afa6837b0d4f8/cf 2023-09-28 09:01:49,824 DEBUG [StoreOpener-92adf1f436dd4aada125cde7ef956ff5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testConsecutiveExports/92adf1f436dd4aada125cde7ef956ff5/cf 2023-09-28 09:01:49,825 INFO [StoreOpener-92adf1f436dd4aada125cde7ef956ff5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 92adf1f436dd4aada125cde7ef956ff5 columnFamilyName cf 2023-09-28 09:01:49,825 INFO [StoreOpener-6dfa2f5692909504c51afa6837b0d4f8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6dfa2f5692909504c51afa6837b0d4f8 columnFamilyName cf 2023-09-28 09:01:49,826 INFO [StoreOpener-92adf1f436dd4aada125cde7ef956ff5-1] regionserver.HStore(310): Store=92adf1f436dd4aada125cde7ef956ff5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 09:01:49,826 INFO [StoreOpener-6dfa2f5692909504c51afa6837b0d4f8-1] regionserver.HStore(310): Store=6dfa2f5692909504c51afa6837b0d4f8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 09:01:49,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testConsecutiveExports/6dfa2f5692909504c51afa6837b0d4f8 2023-09-28 09:01:49,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testConsecutiveExports/92adf1f436dd4aada125cde7ef956ff5 2023-09-28 09:01:49,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testConsecutiveExports/6dfa2f5692909504c51afa6837b0d4f8 2023-09-28 09:01:49,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testConsecutiveExports/92adf1f436dd4aada125cde7ef956ff5 2023-09-28 09:01:49,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6dfa2f5692909504c51afa6837b0d4f8 2023-09-28 09:01:49,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 92adf1f436dd4aada125cde7ef956ff5 2023-09-28 09:01:49,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testConsecutiveExports/6dfa2f5692909504c51afa6837b0d4f8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 09:01:49,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testConsecutiveExports/92adf1f436dd4aada125cde7ef956ff5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 09:01:49,833 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6dfa2f5692909504c51afa6837b0d4f8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71111578, jitterRate=0.05964508652687073}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 09:01:49,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6dfa2f5692909504c51afa6837b0d4f8: 2023-09-28 09:01:49,834 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 92adf1f436dd4aada125cde7ef956ff5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69026930, jitterRate=0.0285814106464386}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 09:01:49,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 92adf1f436dd4aada125cde7ef956ff5: 2023-09-28 09:01:49,834 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1695891709451.6dfa2f5692909504c51afa6837b0d4f8., pid=46, masterSystemTime=1695891709817 2023-09-28 09:01:49,834 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1695891709451.92adf1f436dd4aada125cde7ef956ff5., pid=45, masterSystemTime=1695891709817 2023-09-28 09:01:49,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1695891709451.6dfa2f5692909504c51afa6837b0d4f8. 2023-09-28 09:01:49,836 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1695891709451.6dfa2f5692909504c51afa6837b0d4f8. 2023-09-28 09:01:49,837 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=6dfa2f5692909504c51afa6837b0d4f8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:49,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1695891709451.92adf1f436dd4aada125cde7ef956ff5. 2023-09-28 09:01:49,837 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1695891709451.6dfa2f5692909504c51afa6837b0d4f8.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695891709837"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695891709837"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695891709837"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695891709837"}]},"ts":"1695891709837"} 2023-09-28 09:01:49,837 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1695891709451.92adf1f436dd4aada125cde7ef956ff5. 2023-09-28 09:01:49,837 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=92adf1f436dd4aada125cde7ef956ff5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:49,837 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1695891709451.92adf1f436dd4aada125cde7ef956ff5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695891709837"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695891709837"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695891709837"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695891709837"}]},"ts":"1695891709837"} 2023-09-28 09:01:49,840 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=44 2023-09-28 09:01:49,841 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 6dfa2f5692909504c51afa6837b0d4f8, server=jenkins-hbase4.apache.org,39195,1695891668910 in 173 msec 2023-09-28 09:01:49,841 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=43 2023-09-28 09:01:49,841 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 92adf1f436dd4aada125cde7ef956ff5, server=jenkins-hbase4.apache.org,40311,1695891668959 in 175 msec 2023-09-28 09:01:49,842 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6dfa2f5692909504c51afa6837b0d4f8, ASSIGN in 336 msec 2023-09-28 09:01:49,843 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=43, resume processing ppid=42 2023-09-28 09:01:49,843 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=92adf1f436dd4aada125cde7ef956ff5, ASSIGN in 336 msec 2023-09-28 09:01:49,844 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-28 09:01:49,844 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695891709844"}]},"ts":"1695891709844"} 2023-09-28 09:01:49,845 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-09-28 09:01:49,848 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-09-28 09:01:49,848 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-09-28 09:01:49,850 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40311] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-28 09:01:49,852 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 09:01:49,852 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 09:01:49,852 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 09:01:49,852 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 09:01:49,853 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-28 09:01:49,853 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-28 09:01:49,853 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-28 09:01:49,853 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-28 09:01:49,855 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 401 msec 2023-09-28 09:01:50,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-28 09:01:50,061 INFO [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-09-28 09:01:50,063 DEBUG [Listener at jenkins-hbase4.apache.org/39071] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-28 09:01:50,063 DEBUG [Listener at jenkins-hbase4.apache.org/39071] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695891709451.92adf1f436dd4aada125cde7ef956ff5. 2023-09-28 09:01:50,066 INFO [Listener at jenkins-hbase4.apache.org/39071] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-28 09:01:50,078 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-28 09:01:50,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695891710078 (current time:1695891710078). 2023-09-28 09:01:50,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-28 09:01:50,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] zookeeper.ReadOnlyZKClient(139): Connect 0x6da03bc2 to 127.0.0.1:61959 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 09:01:50,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@93c9228, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 09:01:50,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 09:01:50,088 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42784, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 09:01:50,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6da03bc2 to 127.0.0.1:61959 2023-09-28 09:01:50,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 09:01:50,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] zookeeper.ReadOnlyZKClient(139): Connect 0x0bc011ab to 127.0.0.1:61959 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 09:01:50,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@67d2453a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 09:01:50,098 DEBUG [hconnection-0xa12363a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 09:01:50,101 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42788, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 09:01:50,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0bc011ab to 127.0.0.1:61959 2023-09-28 09:01:50,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 09:01:50,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-28 09:01:50,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-28 09:01:50,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-28 09:01:50,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-28 09:01:50,110 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-28 09:01:50,111 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695892310111 2023-09-28 09:01:50,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-28 09:01:50,111 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-28 09:01:50,112 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-28 09:01:50,112 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-28 09:01:50,113 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-28 09:01:50,113 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-28 09:01:50,114 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-09-28 09:01:50,115 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-28 09:01:50,116 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695892310116 2023-09-28 09:01:50,126 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,126 INFO [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-09-28 09:01:50,126 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 09:01:50,127 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-09-28 09:01:50,127 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-28 09:01:50,127 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,128 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,129 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:01:50,129 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:01:50,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:01:50,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:01:50,129 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:50,129 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:01:50,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:01:50,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:01:50,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:01:50,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:01:50,129 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:50,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,130 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:50,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,130 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,130 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,130 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:50,130 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-28 09:01:50,130 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-28 09:01:50,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-28 09:01:50,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,130 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-28 09:01:50,130 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-28 09:01:50,131 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,131 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-28 09:01:50,131 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 09:01:50,131 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,132 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-28 09:01:50,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-28 09:01:50,132 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-28 09:01:50,132 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-28 09:01:50,132 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 09:01:50,132 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39195,1695891668910' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-28 09:01:50,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,133 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-28 09:01:50,133 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-28 09:01:50,133 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40045,1695891669000' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-28 09:01:50,133 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-28 09:01:50,134 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,134 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-28 09:01:50,134 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 09:01:50,137 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-28 09:01:50,137 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-28 09:01:50,137 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40311,1695891668959' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-28 09:01:50,138 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:50,138 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:50,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:01:50,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:01:50,139 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:01:50,139 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,139 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 09:01:50,139 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,139 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 09:01:50,141 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:50,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:01:50,141 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,141 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,141 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 09:01:50,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:50,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:50,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:50,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:01:50,142 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39195,1695891668910' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-28 09:01:50,142 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4d94a9f6[Count = 1] remaining members to acquire global barrier 2023-09-28 09:01:50,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:50,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:01:50,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:01:50,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:01:50,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:01:50,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:50,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:50,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:50,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:01:50,144 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40311,1695891668959' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-28 09:01:50,144 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4d94a9f6[Count = 0] remaining members to acquire global barrier 2023-09-28 09:01:50,144 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-28 09:01:50,144 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,146 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,146 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,146 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,146 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-28 09:01:50,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,146 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:50,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,146 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 09:01:50,146 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 09:01:50,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,146 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695891709451.6dfa2f5692909504c51afa6837b0d4f8. 2023-09-28 09:01:50,146 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-28 09:01:50,146 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:50,147 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-28 09:01:50,146 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-28 09:01:50,146 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695891709451.6dfa2f5692909504c51afa6837b0d4f8. started... 2023-09-28 09:01:50,147 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-28 09:01:50,147 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 09:01:50,147 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695891709451.92adf1f436dd4aada125cde7ef956ff5. 2023-09-28 09:01:50,147 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 09:01:50,148 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695891709451.92adf1f436dd4aada125cde7ef956ff5. started... 2023-09-28 09:01:50,148 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6dfa2f5692909504c51afa6837b0d4f8: 2023-09-28 09:01:50,147 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40045,1695891669000' in zk 2023-09-28 09:01:50,148 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 92adf1f436dd4aada125cde7ef956ff5: 2023-09-28 09:01:50,148 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695891709451.6dfa2f5692909504c51afa6837b0d4f8.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,148 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 09:01:50,148 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-28 09:01:50,148 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695891709451.92adf1f436dd4aada125cde7ef956ff5.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,149 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 09:01:50,149 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-28 09:01:50,158 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-28 09:01:50,158 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 09:01:50,158 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-28 09:01:50,164 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695891709451.6dfa2f5692909504c51afa6837b0d4f8. completed. 2023-09-28 09:01:50,164 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695891709451.6dfa2f5692909504c51afa6837b0d4f8. 2023-09-28 09:01:50,164 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695891709451.92adf1f436dd4aada125cde7ef956ff5. completed. 2023-09-28 09:01:50,164 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 09:01:50,164 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 09:01:50,164 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:50,164 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695891709451.92adf1f436dd4aada125cde7ef956ff5. 2023-09-28 09:01:50,164 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-28 09:01:50,164 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39195,1695891668910' in zk 2023-09-28 09:01:50,164 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 09:01:50,164 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 09:01:50,164 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:50,164 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-28 09:01:50,164 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40311,1695891668959' in zk 2023-09-28 09:01:50,166 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-28 09:01:50,166 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:50,166 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 09:01:50,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:50,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:01:50,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:01:50,166 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-28 09:01:50,167 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-28 09:01:50,167 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 09:01:50,167 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:50,167 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-28 09:01:50,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:01:50,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:01:50,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:50,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:50,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:50,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:01:50,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:50,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:50,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:50,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39195,1695891668910': 2023-09-28 09:01:50,172 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39195,1695891668910' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-28 09:01:50,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:50,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:01:50,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:01:50,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:01:50,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:01:50,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:50,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:50,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:50,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:01:50,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:50,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:50,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:50,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,40311,1695891668959': 2023-09-28 09:01:50,175 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40311,1695891668959' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-28 09:01:50,175 INFO [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-09-28 09:01:50,175 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-28 09:01:50,175 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-28 09:01:50,175 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,175 INFO [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-28 09:01:50,177 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,177 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,177 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:01:50,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:01:50,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:01:50,177 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,177 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,177 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:01:50,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,177 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:01:50,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,178 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:50,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:01:50,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:01:50,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:01:50,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,178 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:50,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:01:50,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:01:50,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:01:50,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,179 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:50,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:01:50,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:01:50,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:50,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:50,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:50,181 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:50,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:01:50,181 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:50,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,182 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:50,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:50,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:50,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:50,185 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:50,185 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,185 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:50,185 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:01:50,185 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:50,185 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:01:50,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:01:50,185 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:01:50,185 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:01:50,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:01:50,185 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 09:01:50,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:01:50,185 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:01:50,185 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:01:50,185 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,187 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:01:50,187 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-28 09:01:50,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:01:50,185 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:01:50,187 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:01:50,187 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-28 09:01:50,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:01:50,187 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:50,187 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:01:50,188 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:01:50,188 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:50,188 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:50,188 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,188 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:01:50,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:01:50,188 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-28 09:01:50,202 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,203 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,212 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 09:01:50,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-28 09:01:50,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-28 09:01:50,214 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-28 09:01:50,231 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,232 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-28 09:01:50,232 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,232 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-28 09:01:50,232 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695891710111Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695891710202 (+91 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1695891710202Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1695891710202Writing data manifest for emptySnaptb0-testConsecutiveExports at 1695891710207 (+5 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1695891710225 (+18 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695891710232 (+7 ms) 2023-09-28 09:01:50,235 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-28 09:01:50,236 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 123 msec 2023-09-28 09:01:50,414 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 09:01:50,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-28 09:01:50,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-28 09:01:50,417 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1695891709451.92adf1f436dd4aada125cde7ef956ff5. with WAL disabled. Data may be lost in the event of a crash. 2023-09-28 09:01:50,419 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39195] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1695891709451.6dfa2f5692909504c51afa6837b0d4f8. with WAL disabled. Data may be lost in the event of a crash. 2023-09-28 09:01:50,422 DEBUG [Listener at jenkins-hbase4.apache.org/39071] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-28 09:01:50,422 DEBUG [Listener at jenkins-hbase4.apache.org/39071] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695891709451.92adf1f436dd4aada125cde7ef956ff5. 2023-09-28 09:01:50,423 INFO [Listener at jenkins-hbase4.apache.org/39071] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-28 09:01:50,434 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-28 09:01:50,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695891710434 (current time:1695891710434). 2023-09-28 09:01:50,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-28 09:01:50,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] zookeeper.ReadOnlyZKClient(139): Connect 0x081222c7 to 127.0.0.1:61959 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 09:01:50,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b5295e0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 09:01:50,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 09:01:50,452 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42798, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 09:01:50,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x081222c7 to 127.0.0.1:61959 2023-09-28 09:01:50,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 09:01:50,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] zookeeper.ReadOnlyZKClient(139): Connect 0x02e6f866 to 127.0.0.1:61959 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 09:01:50,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1bfbe6e7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 09:01:50,464 DEBUG [hconnection-0x54c98ded-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 09:01:50,466 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42814, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 09:01:50,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x02e6f866 to 127.0.0.1:61959 2023-09-28 09:01:50,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 09:01:50,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-28 09:01:50,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-28 09:01:50,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-28 09:01:50,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-28 09:01:50,477 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-28 09:01:50,478 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695892310478 2023-09-28 09:01:50,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-28 09:01:50,478 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-28 09:01:50,479 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-28 09:01:50,480 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-28 09:01:50,480 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-28 09:01:50,484 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-28 09:01:50,485 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 10 msec 2023-09-28 09:01:50,487 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-28 09:01:50,487 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695892310487 2023-09-28 09:01:50,500 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-09-28 09:01:50,500 INFO [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-09-28 09:01:50,500 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 09:01:50,502 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-09-28 09:01:50,502 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-28 09:01:50,502 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 09:01:50,502 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-28 09:01:50,504 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:50,504 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:01:50,504 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:01:50,504 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:01:50,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:01:50,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:01:50,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:01:50,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:01:50,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:01:50,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:01:50,504 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:50,504 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:50,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-28 09:01:50,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-28 09:01:50,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-28 09:01:50,505 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:50,505 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-28 09:01:50,505 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 09:01:50,505 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 09:01:50,505 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 09:01:50,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-28 09:01:50,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-28 09:01:50,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-28 09:01:50,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-28 09:01:50,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-28 09:01:50,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-28 09:01:50,506 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-28 09:01:50,506 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-28 09:01:50,506 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-28 09:01:50,506 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-28 09:01:50,506 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-28 09:01:50,506 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 09:01:50,506 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-28 09:01:50,507 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-28 09:01:50,507 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-28 09:01:50,507 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 09:01:50,507 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-28 09:01:50,507 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-28 09:01:50,509 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40311,1695891668959' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-28 09:01:50,509 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-28 09:01:50,509 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 09:01:50,508 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-28 09:01:50,510 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-28 09:01:50,510 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-28 09:01:50,510 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-28 09:01:50,510 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39195,1695891668910' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-28 09:01:50,510 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40045,1695891669000' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-28 09:01:50,511 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 09:01:50,511 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:50,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:50,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:01:50,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:01:50,511 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 09:01:50,511 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 09:01:50,512 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:50,512 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 09:01:50,515 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 09:01:50,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:01:50,515 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 09:01:50,515 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 09:01:50,515 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 09:01:50,515 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 09:01:50,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:01:50,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-28 09:01:50,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:50,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:50,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:50,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:01:50,517 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40311,1695891668959' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-28 09:01:50,517 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c2874ef[Count = 1] remaining members to acquire global barrier 2023-09-28 09:01:50,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:50,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:01:50,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:01:50,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:01:50,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:01:50,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-28 09:01:50,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:50,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:50,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:50,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:01:50,519 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39195,1695891668910' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-28 09:01:50,519 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c2874ef[Count = 0] remaining members to acquire global barrier 2023-09-28 09:01:50,519 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-28 09:01:50,519 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 09:01:50,520 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 09:01:50,520 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 09:01:50,520 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 09:01:50,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 09:01:50,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 09:01:50,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 09:01:50,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 09:01:50,520 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-28 09:01:50,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 09:01:50,520 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:50,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 09:01:50,521 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 09:01:50,521 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-28 09:01:50,521 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-28 09:01:50,521 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-28 09:01:50,521 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40045,1695891669000' in zk 2023-09-28 09:01:50,521 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695891709451.92adf1f436dd4aada125cde7ef956ff5. 2023-09-28 09:01:50,521 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 09:01:50,521 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695891709451.92adf1f436dd4aada125cde7ef956ff5. started... 2023-09-28 09:01:50,521 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695891709451.6dfa2f5692909504c51afa6837b0d4f8. 2023-09-28 09:01:50,521 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:50,521 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-28 09:01:50,521 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 09:01:50,521 INFO [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 92adf1f436dd4aada125cde7ef956ff5 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-28 09:01:50,521 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695891709451.6dfa2f5692909504c51afa6837b0d4f8. started... 2023-09-28 09:01:50,521 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 09:01:50,522 INFO [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6dfa2f5692909504c51afa6837b0d4f8 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-28 09:01:50,523 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-28 09:01:50,523 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 09:01:50,523 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-28 09:01:50,553 INFO [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023092834113e09090140ada1fc267f003b237f to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023092834113e09090140ada1fc267f003b237f 2023-09-28 09:01:50,553 INFO [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230928674d29acf3f44c9ab8d83e16ba86a358 to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230928674d29acf3f44c9ab8d83e16ba86a358 2023-09-28 09:01:50,567 INFO [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testConsecutiveExports/6dfa2f5692909504c51afa6837b0d4f8/.tmp/cf/6195c2fc6e9d4313b495c1fd6a14d361 2023-09-28 09:01:50,568 INFO [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testConsecutiveExports/92adf1f436dd4aada125cde7ef956ff5/.tmp/cf/633f281ef32f4b7f9e7fcbfa986e527b 2023-09-28 09:01:50,574 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testConsecutiveExports/92adf1f436dd4aada125cde7ef956ff5/.tmp/cf/633f281ef32f4b7f9e7fcbfa986e527b as hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testConsecutiveExports/92adf1f436dd4aada125cde7ef956ff5/cf/633f281ef32f4b7f9e7fcbfa986e527b 2023-09-28 09:01:50,575 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testConsecutiveExports/6dfa2f5692909504c51afa6837b0d4f8/.tmp/cf/6195c2fc6e9d4313b495c1fd6a14d361 as hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testConsecutiveExports/6dfa2f5692909504c51afa6837b0d4f8/cf/6195c2fc6e9d4313b495c1fd6a14d361 2023-09-28 09:01:50,580 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 09:01:50,580 INFO [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testConsecutiveExports/92adf1f436dd4aada125cde7ef956ff5/cf/633f281ef32f4b7f9e7fcbfa986e527b, entries=4, sequenceid=6, filesize=5.6 K 2023-09-28 09:01:50,581 INFO [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testConsecutiveExports/6dfa2f5692909504c51afa6837b0d4f8/cf/6195c2fc6e9d4313b495c1fd6a14d361, entries=46, sequenceid=6, filesize=12.5 K 2023-09-28 09:01:50,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-28 09:01:50,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-28 09:01:50,581 INFO [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 92adf1f436dd4aada125cde7ef956ff5 in 60ms, sequenceid=6, compaction requested=false 2023-09-28 09:01:50,581 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-28 09:01:50,581 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-28 09:01:50,582 INFO [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 6dfa2f5692909504c51afa6837b0d4f8 in 60ms, sequenceid=6, compaction requested=false 2023-09-28 09:01:50,582 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-28 09:01:50,584 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6dfa2f5692909504c51afa6837b0d4f8: 2023-09-28 09:01:50,584 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 92adf1f436dd4aada125cde7ef956ff5: 2023-09-28 09:01:50,584 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695891709451.92adf1f436dd4aada125cde7ef956ff5.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-28 09:01:50,584 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695891709451.6dfa2f5692909504c51afa6837b0d4f8.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-28 09:01:50,584 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 09:01:50,584 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 09:01:50,584 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testConsecutiveExports/92adf1f436dd4aada125cde7ef956ff5/cf/633f281ef32f4b7f9e7fcbfa986e527b] hfiles 2023-09-28 09:01:50,584 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testConsecutiveExports/6dfa2f5692909504c51afa6837b0d4f8/cf/6195c2fc6e9d4313b495c1fd6a14d361] hfiles 2023-09-28 09:01:50,584 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testConsecutiveExports/92adf1f436dd4aada125cde7ef956ff5/cf/633f281ef32f4b7f9e7fcbfa986e527b for snapshot=snaptb0-testConsecutiveExports 2023-09-28 09:01:50,584 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testConsecutiveExports/6dfa2f5692909504c51afa6837b0d4f8/cf/6195c2fc6e9d4313b495c1fd6a14d361 for snapshot=snaptb0-testConsecutiveExports 2023-09-28 09:01:50,596 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695891709451.92adf1f436dd4aada125cde7ef956ff5. completed. 2023-09-28 09:01:50,596 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695891709451.92adf1f436dd4aada125cde7ef956ff5. 2023-09-28 09:01:50,596 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 09:01:50,596 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 09:01:50,596 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:50,596 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-28 09:01:50,596 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40311,1695891668959' in zk 2023-09-28 09:01:50,597 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695891709451.6dfa2f5692909504c51afa6837b0d4f8. completed. 2023-09-28 09:01:50,597 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695891709451.6dfa2f5692909504c51afa6837b0d4f8. 2023-09-28 09:01:50,597 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 09:01:50,597 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 09:01:50,597 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:50,597 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-28 09:01:50,597 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39195,1695891668910' in zk 2023-09-28 09:01:50,598 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:50,598 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-28 09:01:50,598 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 09:01:50,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:50,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:01:50,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:01:50,598 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-28 09:01:50,602 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:50,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:01:50,602 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-28 09:01:50,602 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 09:01:50,602 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-28 09:01:50,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:01:50,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-28 09:01:50,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:50,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:50,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:50,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:01:50,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-28 09:01:50,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:50,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:50,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:50,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,40311,1695891668959': 2023-09-28 09:01:50,607 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40311,1695891668959' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-28 09:01:50,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:50,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:01:50,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:01:50,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:01:50,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:01:50,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-28 09:01:50,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:50,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:50,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:50,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:01:50,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-28 09:01:50,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:50,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:50,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:50,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39195,1695891668910': 2023-09-28 09:01:50,610 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39195,1695891668910' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-28 09:01:50,610 INFO [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-09-28 09:01:50,611 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-28 09:01:50,611 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-28 09:01:50,611 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-09-28 09:01:50,611 INFO [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-28 09:01:50,613 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 09:01:50,613 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 09:01:50,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 09:01:50,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 09:01:50,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 09:01:50,613 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:01:50,613 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:01:50,613 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 09:01:50,613 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 09:01:50,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 09:01:50,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 09:01:50,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 09:01:50,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:01:50,613 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:50,613 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:01:50,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 09:01:50,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:01:50,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:01:50,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:01:50,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:01:50,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:01:50,614 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:50,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:01:50,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:01:50,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 09:01:50,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 09:01:50,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:01:50,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 09:01:50,614 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:50,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-28 09:01:50,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:01:50,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-28 09:01:50,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:50,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:50,617 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:50,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:50,618 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:50,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:01:50,618 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:50,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-28 09:01:50,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:50,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:50,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:50,624 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:01:50,624 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:50,624 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:01:50,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:01:50,624 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:01:50,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:01:50,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:01:50,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:01:50,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:01:50,624 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:01:50,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:01:50,624 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:01:50,624 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-28 09:01:50,625 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:50,625 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:50,625 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-28 09:01:50,625 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:01:50,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:01:50,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:01:50,624 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-09-28 09:01:50,624 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:01:50,625 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-28 09:01:50,624 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 09:01:50,625 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-28 09:01:50,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:01:50,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:01:50,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:01:50,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:01:50,625 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 09:01:50,625 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-28 09:01:50,627 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:01:50,627 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:01:50,627 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 09:01:50,627 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 09:01:50,628 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023092834113e09090140ada1fc267f003b237f, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230928674d29acf3f44c9ab8d83e16ba86a358] mob files 2023-09-28 09:01:50,628 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023092834113e09090140ada1fc267f003b237f 2023-09-28 09:01:50,628 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230928674d29acf3f44c9ab8d83e16ba86a358 2023-09-28 09:01:50,640 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-09-28 09:01:50,641 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-28 09:01:50,661 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-28 09:01:50,662 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-28 09:01:50,662 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-28 09:01:50,662 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-28 09:01:50,662 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695891710478Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695891710640 (+162 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1695891710640Loading Region manifests for snaptb0-testConsecutiveExports at 1695891710640Writing data manifest for snaptb0-testConsecutiveExports at 1695891710644 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1695891710654 (+10 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695891710662 (+8 ms) 2023-09-28 09:01:50,665 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-28 09:01:50,667 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 186 msec 2023-09-28 09:01:50,781 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 09:01:50,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-28 09:01:50,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-28 09:01:50,783 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/local-export-1695891710783 2023-09-28 09:01:50,783 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/local-export-1695891710783, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/local-export-1695891710783, srcFsUri=hdfs://localhost:39781, srcDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba 2023-09-28 09:01:50,805 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39781, inputRoot=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba 2023-09-28 09:01:50,805 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@5b5c38fd, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/local-export-1695891710783, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/local-export-1695891710783/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-28 09:01:50,805 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39781, inputRoot=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba, snapshotDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-28 09:01:50,814 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/local-export-1695891710783/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-28 09:01:50,826 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-28 09:01:50,826 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-28 09:01:50,827 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-28 09:01:50,827 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-28 09:01:51,725 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/hadoop-8913525136197700519.jar 2023-09-28 09:01:51,726 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-28 09:01:51,726 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-28 09:01:51,792 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/hadoop-31345203698742331.jar 2023-09-28 09:01:51,792 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-28 09:01:51,793 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-28 09:01:51,793 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-28 09:01:51,794 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-28 09:01:51,794 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-28 09:01:51,794 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-28 09:01:51,795 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-28 09:01:51,795 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-28 09:01:51,795 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-28 09:01:51,796 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-28 09:01:51,796 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-28 09:01:51,797 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-28 09:01:51,797 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-28 09:01:51,797 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-28 09:01:51,797 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-28 09:01:51,798 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-28 09:01:51,799 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 09:01:51,799 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 09:01:51,800 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 09:01:51,800 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 09:01:51,800 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 09:01:51,801 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 09:01:51,801 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 09:01:52,167 WARN [Listener at jenkins-hbase4.apache.org/39071] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-28 09:01:52,170 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-28 09:01:52,172 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-28 09:01:53,343 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 09:01:53,343 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 09:01:53,346 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695891675416_0002_000001 (auth:SIMPLE) 2023-09-28 09:01:54,148 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695891675416_0003_000001 (auth:SIMPLE) 2023-09-28 09:01:54,730 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-28 09:01:57,974 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695891675416_0003_000001 (auth:SIMPLE) 2023-09-28 09:02:00,190 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695891675416_0003_000001 (auth:SIMPLE) 2023-09-28 09:02:02,523 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695891675416_0003_000001 (auth:SIMPLE) 2023-09-28 09:02:04,330 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-28 09:02:04,330 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-28 09:02:04,334 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-28 09:02:04,334 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-28 09:02:04,335 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-28 09:02:04,335 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1698010877_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-28 09:02:04,338 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(367): hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-28 09:02:04,338 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(367): hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-28 09:02:04,338 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@1a3a2a01 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/local-export-1695891710783/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/local-export-1695891710783/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-28 09:02:04,338 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/local-export-1695891710783/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-28 09:02:04,338 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/local-export-1695891710783/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-28 09:02:04,339 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/local-export-1695891710783, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/local-export-1695891710783, srcFsUri=hdfs://localhost:39781, srcDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba 2023-09-28 09:02:04,362 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39781, inputRoot=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba 2023-09-28 09:02:04,362 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@6f6e716a, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/local-export-1695891710783, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/local-export-1695891710783/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-28 09:02:04,362 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39781, inputRoot=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba, snapshotDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-28 09:02:04,373 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/local-export-1695891710783/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-28 09:02:04,384 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-28 09:02:04,385 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-28 09:02:04,385 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-28 09:02:04,386 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-28 09:02:05,264 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/hadoop-2636440073804922288.jar 2023-09-28 09:02:05,265 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-28 09:02:05,265 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-28 09:02:05,331 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/hadoop-272336342645362714.jar 2023-09-28 09:02:05,331 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-28 09:02:05,332 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-28 09:02:05,332 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-28 09:02:05,333 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-28 09:02:05,333 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-28 09:02:05,333 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-28 09:02:05,334 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-28 09:02:05,334 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-28 09:02:05,334 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-28 09:02:05,335 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-28 09:02:05,335 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-28 09:02:05,336 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-28 09:02:05,336 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-28 09:02:05,336 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-28 09:02:05,336 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-28 09:02:05,337 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-28 09:02:05,338 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 09:02:05,338 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 09:02:05,339 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 09:02:05,339 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 09:02:05,339 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 09:02:05,340 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 09:02:05,340 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 09:02:05,731 WARN [Listener at jenkins-hbase4.apache.org/39071] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-28 09:02:05,733 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-28 09:02:05,735 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-28 09:02:08,694 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 09:02:08,694 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 09:02:08,697 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695891675416_0003_000001 (auth:SIMPLE) 2023-09-28 09:02:09,355 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695891675416_0004_000001 (auth:SIMPLE) 2023-09-28 09:02:13,083 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695891675416_0004_000001 (auth:SIMPLE) 2023-09-28 09:02:15,294 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695891675416_0004_000001 (auth:SIMPLE) 2023-09-28 09:02:17,574 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695891675416_0004_000001 (auth:SIMPLE) 2023-09-28 09:02:18,889 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-28 09:02:18,890 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-28 09:02:18,892 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-28 09:02:18,893 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-28 09:02:18,893 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-28 09:02:18,893 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1698010877_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-28 09:02:18,897 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(367): hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-28 09:02:18,897 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(367): hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-28 09:02:18,897 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@1a3a2a01 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/local-export-1695891710783/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/local-export-1695891710783/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-28 09:02:18,897 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/local-export-1695891710783/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-28 09:02:18,897 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/local-export-1695891710783/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-28 09:02:18,910 INFO [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-09-28 09:02:18,910 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-09-28 09:02:18,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-09-28 09:02:18,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-28 09:02:18,914 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695891738914"}]},"ts":"1695891738914"} 2023-09-28 09:02:18,916 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-09-28 09:02:18,917 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-09-28 09:02:18,918 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=92adf1f436dd4aada125cde7ef956ff5, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6dfa2f5692909504c51afa6837b0d4f8, UNASSIGN}] 2023-09-28 09:02:18,920 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=92adf1f436dd4aada125cde7ef956ff5, UNASSIGN 2023-09-28 09:02:18,920 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6dfa2f5692909504c51afa6837b0d4f8, UNASSIGN 2023-09-28 09:02:18,920 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=92adf1f436dd4aada125cde7ef956ff5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:18,920 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=6dfa2f5692909504c51afa6837b0d4f8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:18,921 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695891709451.6dfa2f5692909504c51afa6837b0d4f8.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695891738920"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695891738920"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695891738920"}]},"ts":"1695891738920"} 2023-09-28 09:02:18,921 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695891709451.92adf1f436dd4aada125cde7ef956ff5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695891738920"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695891738920"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695891738920"}]},"ts":"1695891738920"} 2023-09-28 09:02:18,922 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 92adf1f436dd4aada125cde7ef956ff5, server=jenkins-hbase4.apache.org,40311,1695891668959}] 2023-09-28 09:02:18,923 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 6dfa2f5692909504c51afa6837b0d4f8, server=jenkins-hbase4.apache.org,39195,1695891668910}] 2023-09-28 09:02:19,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-28 09:02:19,074 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 92adf1f436dd4aada125cde7ef956ff5 2023-09-28 09:02:19,074 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6dfa2f5692909504c51afa6837b0d4f8 2023-09-28 09:02:19,075 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 92adf1f436dd4aada125cde7ef956ff5, disabling compactions & flushes 2023-09-28 09:02:19,075 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6dfa2f5692909504c51afa6837b0d4f8, disabling compactions & flushes 2023-09-28 09:02:19,075 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695891709451.92adf1f436dd4aada125cde7ef956ff5. 2023-09-28 09:02:19,075 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695891709451.6dfa2f5692909504c51afa6837b0d4f8. 2023-09-28 09:02:19,075 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695891709451.92adf1f436dd4aada125cde7ef956ff5. 2023-09-28 09:02:19,075 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695891709451.6dfa2f5692909504c51afa6837b0d4f8. 2023-09-28 09:02:19,075 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695891709451.92adf1f436dd4aada125cde7ef956ff5. after waiting 0 ms 2023-09-28 09:02:19,075 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695891709451.6dfa2f5692909504c51afa6837b0d4f8. after waiting 0 ms 2023-09-28 09:02:19,075 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695891709451.6dfa2f5692909504c51afa6837b0d4f8. 2023-09-28 09:02:19,075 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695891709451.92adf1f436dd4aada125cde7ef956ff5. 2023-09-28 09:02:19,087 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testConsecutiveExports/6dfa2f5692909504c51afa6837b0d4f8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-28 09:02:19,087 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testConsecutiveExports/92adf1f436dd4aada125cde7ef956ff5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-28 09:02:19,088 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 09:02:19,088 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 09:02:19,090 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695891709451.6dfa2f5692909504c51afa6837b0d4f8. 2023-09-28 09:02:19,090 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695891709451.92adf1f436dd4aada125cde7ef956ff5. 2023-09-28 09:02:19,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6dfa2f5692909504c51afa6837b0d4f8: 2023-09-28 09:02:19,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 92adf1f436dd4aada125cde7ef956ff5: 2023-09-28 09:02:19,091 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 92adf1f436dd4aada125cde7ef956ff5 2023-09-28 09:02:19,092 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=92adf1f436dd4aada125cde7ef956ff5, regionState=CLOSED 2023-09-28 09:02:19,092 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6dfa2f5692909504c51afa6837b0d4f8 2023-09-28 09:02:19,092 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695891709451.92adf1f436dd4aada125cde7ef956ff5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695891739092"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695891739092"}]},"ts":"1695891739092"} 2023-09-28 09:02:19,093 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=6dfa2f5692909504c51afa6837b0d4f8, regionState=CLOSED 2023-09-28 09:02:19,093 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695891709451.6dfa2f5692909504c51afa6837b0d4f8.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695891739093"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695891739093"}]},"ts":"1695891739093"} 2023-09-28 09:02:19,096 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=52 2023-09-28 09:02:19,096 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 92adf1f436dd4aada125cde7ef956ff5, server=jenkins-hbase4.apache.org,40311,1695891668959 in 172 msec 2023-09-28 09:02:19,097 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=53 2023-09-28 09:02:19,097 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 6dfa2f5692909504c51afa6837b0d4f8, server=jenkins-hbase4.apache.org,39195,1695891668910 in 171 msec 2023-09-28 09:02:19,097 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=92adf1f436dd4aada125cde7ef956ff5, UNASSIGN in 178 msec 2023-09-28 09:02:19,098 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-09-28 09:02:19,098 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6dfa2f5692909504c51afa6837b0d4f8, UNASSIGN in 179 msec 2023-09-28 09:02:19,099 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695891739099"}]},"ts":"1695891739099"} 2023-09-28 09:02:19,100 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-09-28 09:02:19,102 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-09-28 09:02:19,104 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 193 msec 2023-09-28 09:02:19,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-28 09:02:19,216 INFO [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-09-28 09:02:19,217 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-09-28 09:02:19,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-28 09:02:19,220 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-28 09:02:19,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-09-28 09:02:19,221 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-28 09:02:19,223 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40311] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-09-28 09:02:19,226 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testConsecutiveExports/92adf1f436dd4aada125cde7ef956ff5 2023-09-28 09:02:19,226 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testConsecutiveExports/6dfa2f5692909504c51afa6837b0d4f8 2023-09-28 09:02:19,227 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-28 09:02:19,227 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-28 09:02:19,227 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-28 09:02:19,227 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-28 09:02:19,227 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-28 09:02:19,228 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-28 09:02:19,228 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-28 09:02:19,228 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-28 09:02:19,228 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-28 09:02:19,228 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 09:02:19,228 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 09:02:19,229 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-09-28 09:02:19,229 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-28 09:02:19,229 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testConsecutiveExports/92adf1f436dd4aada125cde7ef956ff5/cf, FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testConsecutiveExports/92adf1f436dd4aada125cde7ef956ff5/recovered.edits] 2023-09-28 09:02:19,228 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-28 09:02:19,229 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 09:02:19,229 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 09:02:19,229 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testConsecutiveExports/6dfa2f5692909504c51afa6837b0d4f8/cf, FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testConsecutiveExports/6dfa2f5692909504c51afa6837b0d4f8/recovered.edits] 2023-09-28 09:02:19,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-28 09:02:19,237 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testConsecutiveExports/92adf1f436dd4aada125cde7ef956ff5/cf/633f281ef32f4b7f9e7fcbfa986e527b to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/archive/data/default/testtb-testConsecutiveExports/92adf1f436dd4aada125cde7ef956ff5/cf/633f281ef32f4b7f9e7fcbfa986e527b 2023-09-28 09:02:19,237 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testConsecutiveExports/6dfa2f5692909504c51afa6837b0d4f8/cf/6195c2fc6e9d4313b495c1fd6a14d361 to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/archive/data/default/testtb-testConsecutiveExports/6dfa2f5692909504c51afa6837b0d4f8/cf/6195c2fc6e9d4313b495c1fd6a14d361 2023-09-28 09:02:19,240 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testConsecutiveExports/92adf1f436dd4aada125cde7ef956ff5/recovered.edits/9.seqid to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/archive/data/default/testtb-testConsecutiveExports/92adf1f436dd4aada125cde7ef956ff5/recovered.edits/9.seqid 2023-09-28 09:02:19,240 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testConsecutiveExports/6dfa2f5692909504c51afa6837b0d4f8/recovered.edits/9.seqid to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/archive/data/default/testtb-testConsecutiveExports/6dfa2f5692909504c51afa6837b0d4f8/recovered.edits/9.seqid 2023-09-28 09:02:19,240 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testConsecutiveExports/92adf1f436dd4aada125cde7ef956ff5 2023-09-28 09:02:19,240 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testConsecutiveExports/6dfa2f5692909504c51afa6837b0d4f8 2023-09-28 09:02:19,241 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-28 09:02:19,241 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-28 09:02:19,242 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-09-28 09:02:19,244 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023092834113e09090140ada1fc267f003b237f to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023092834113e09090140ada1fc267f003b237f 2023-09-28 09:02:19,246 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230928674d29acf3f44c9ab8d83e16ba86a358 to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230928674d29acf3f44c9ab8d83e16ba86a358 2023-09-28 09:02:19,246 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-28 09:02:19,248 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-28 09:02:19,251 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-09-28 09:02:19,252 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-09-28 09:02:19,253 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-28 09:02:19,254 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-09-28 09:02:19,254 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1695891709451.92adf1f436dd4aada125cde7ef956ff5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695891739254"}]},"ts":"9223372036854775807"} 2023-09-28 09:02:19,254 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1695891709451.6dfa2f5692909504c51afa6837b0d4f8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695891739254"}]},"ts":"9223372036854775807"} 2023-09-28 09:02:19,255 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-28 09:02:19,255 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 92adf1f436dd4aada125cde7ef956ff5, NAME => 'testtb-testConsecutiveExports,,1695891709451.92adf1f436dd4aada125cde7ef956ff5.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 6dfa2f5692909504c51afa6837b0d4f8, NAME => 'testtb-testConsecutiveExports,1,1695891709451.6dfa2f5692909504c51afa6837b0d4f8.', STARTKEY => '1', ENDKEY => ''}] 2023-09-28 09:02:19,255 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-09-28 09:02:19,256 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695891739255"}]},"ts":"9223372036854775807"} 2023-09-28 09:02:19,257 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-09-28 09:02:19,259 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-28 09:02:19,260 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 42 msec 2023-09-28 09:02:19,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-28 09:02:19,335 INFO [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-09-28 09:02:19,342 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-09-28 09:02:19,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-09-28 09:02:19,345 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-09-28 09:02:19,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-09-28 09:02:19,371 INFO [Listener at jenkins-hbase4.apache.org/39071] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=750 (was 765), OpenFileDescriptor=900 (was 933), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=259 (was 197) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=4730 (was 4871) 2023-09-28 09:02:19,371 WARN [Listener at jenkins-hbase4.apache.org/39071] hbase.ResourceChecker(130): Thread=750 is superior to 500 2023-09-28 09:02:19,390 INFO [Listener at jenkins-hbase4.apache.org/39071] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=749, OpenFileDescriptor=900, MaxFileDescriptor=60000, SystemLoadAverage=259, ProcessCount=168, AvailableMemoryMB=4729 2023-09-28 09:02:19,390 WARN [Listener at jenkins-hbase4.apache.org/39071] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-09-28 09:02:19,392 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-28 09:02:19,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:19,395 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-09-28 09:02:19,395 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-09-28 09:02:19,396 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-28 09:02:19,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-28 09:02:19,399 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/73ef00c40f86e6757c56d65afe439aba 2023-09-28 09:02:19,399 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f80ccbc58e4ace77590e2ce4207efe8 2023-09-28 09:02:19,399 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/73ef00c40f86e6757c56d65afe439aba empty. 2023-09-28 09:02:19,399 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f80ccbc58e4ace77590e2ce4207efe8 empty. 2023-09-28 09:02:19,400 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/73ef00c40f86e6757c56d65afe439aba 2023-09-28 09:02:19,400 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f80ccbc58e4ace77590e2ce4207efe8 2023-09-28 09:02:19,400 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-28 09:02:19,416 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-09-28 09:02:19,417 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 73ef00c40f86e6757c56d65afe439aba, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695891739392.73ef00c40f86e6757c56d65afe439aba.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp 2023-09-28 09:02:19,417 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 6f80ccbc58e4ace77590e2ce4207efe8, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695891739392.6f80ccbc58e4ace77590e2ce4207efe8.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp 2023-09-28 09:02:19,430 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695891739392.73ef00c40f86e6757c56d65afe439aba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 09:02:19,431 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 73ef00c40f86e6757c56d65afe439aba, disabling compactions & flushes 2023-09-28 09:02:19,431 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695891739392.6f80ccbc58e4ace77590e2ce4207efe8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 09:02:19,431 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695891739392.73ef00c40f86e6757c56d65afe439aba. 2023-09-28 09:02:19,431 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 6f80ccbc58e4ace77590e2ce4207efe8, disabling compactions & flushes 2023-09-28 09:02:19,431 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695891739392.73ef00c40f86e6757c56d65afe439aba. 2023-09-28 09:02:19,431 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695891739392.6f80ccbc58e4ace77590e2ce4207efe8. 2023-09-28 09:02:19,431 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695891739392.73ef00c40f86e6757c56d65afe439aba. after waiting 0 ms 2023-09-28 09:02:19,431 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695891739392.6f80ccbc58e4ace77590e2ce4207efe8. 2023-09-28 09:02:19,431 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695891739392.6f80ccbc58e4ace77590e2ce4207efe8. after waiting 0 ms 2023-09-28 09:02:19,431 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695891739392.6f80ccbc58e4ace77590e2ce4207efe8. 2023-09-28 09:02:19,431 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695891739392.73ef00c40f86e6757c56d65afe439aba. 2023-09-28 09:02:19,431 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695891739392.6f80ccbc58e4ace77590e2ce4207efe8. 2023-09-28 09:02:19,431 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695891739392.73ef00c40f86e6757c56d65afe439aba. 2023-09-28 09:02:19,431 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 6f80ccbc58e4ace77590e2ce4207efe8: 2023-09-28 09:02:19,431 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 73ef00c40f86e6757c56d65afe439aba: 2023-09-28 09:02:19,434 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-09-28 09:02:19,435 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695891739392.6f80ccbc58e4ace77590e2ce4207efe8.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695891739435"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695891739435"}]},"ts":"1695891739435"} 2023-09-28 09:02:19,435 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695891739392.73ef00c40f86e6757c56d65afe439aba.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695891739435"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695891739435"}]},"ts":"1695891739435"} 2023-09-28 09:02:19,444 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-28 09:02:19,445 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-28 09:02:19,445 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695891739445"}]},"ts":"1695891739445"} 2023-09-28 09:02:19,447 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-09-28 09:02:19,450 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-28 09:02:19,452 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-28 09:02:19,452 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-28 09:02:19,452 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-28 09:02:19,452 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-28 09:02:19,452 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=73ef00c40f86e6757c56d65afe439aba, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6f80ccbc58e4ace77590e2ce4207efe8, ASSIGN}] 2023-09-28 09:02:19,454 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6f80ccbc58e4ace77590e2ce4207efe8, ASSIGN 2023-09-28 09:02:19,454 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=73ef00c40f86e6757c56d65afe439aba, ASSIGN 2023-09-28 09:02:19,455 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=73ef00c40f86e6757c56d65afe439aba, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40311,1695891668959; forceNewPlan=false, retain=false 2023-09-28 09:02:19,455 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6f80ccbc58e4ace77590e2ce4207efe8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40045,1695891669000; forceNewPlan=false, retain=false 2023-09-28 09:02:19,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-28 09:02:19,605 INFO [jenkins-hbase4:40293] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-28 09:02:19,608 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=73ef00c40f86e6757c56d65afe439aba, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:19,608 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=6f80ccbc58e4ace77590e2ce4207efe8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:19,608 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695891739392.73ef00c40f86e6757c56d65afe439aba.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695891739608"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695891739608"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695891739608"}]},"ts":"1695891739608"} 2023-09-28 09:02:19,608 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695891739392.6f80ccbc58e4ace77590e2ce4207efe8.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695891739608"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695891739608"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695891739608"}]},"ts":"1695891739608"} 2023-09-28 09:02:19,610 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure 73ef00c40f86e6757c56d65afe439aba, server=jenkins-hbase4.apache.org,40311,1695891668959}] 2023-09-28 09:02:19,611 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure 6f80ccbc58e4ace77590e2ce4207efe8, server=jenkins-hbase4.apache.org,40045,1695891669000}] 2023-09-28 09:02:19,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-28 09:02:19,768 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1695891739392.73ef00c40f86e6757c56d65afe439aba. 2023-09-28 09:02:19,768 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1695891739392.6f80ccbc58e4ace77590e2ce4207efe8. 2023-09-28 09:02:19,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 73ef00c40f86e6757c56d65afe439aba, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695891739392.73ef00c40f86e6757c56d65afe439aba.', STARTKEY => '', ENDKEY => '1'} 2023-09-28 09:02:19,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6f80ccbc58e4ace77590e2ce4207efe8, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695891739392.6f80ccbc58e4ace77590e2ce4207efe8.', STARTKEY => '1', ENDKEY => ''} 2023-09-28 09:02:19,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1695891739392.73ef00c40f86e6757c56d65afe439aba. service=AccessControlService 2023-09-28 09:02:19,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1695891739392.6f80ccbc58e4ace77590e2ce4207efe8. service=AccessControlService 2023-09-28 09:02:19,769 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 09:02:19,769 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 09:02:19,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 73ef00c40f86e6757c56d65afe439aba 2023-09-28 09:02:19,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 6f80ccbc58e4ace77590e2ce4207efe8 2023-09-28 09:02:19,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695891739392.73ef00c40f86e6757c56d65afe439aba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 09:02:19,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695891739392.6f80ccbc58e4ace77590e2ce4207efe8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 09:02:19,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 73ef00c40f86e6757c56d65afe439aba 2023-09-28 09:02:19,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6f80ccbc58e4ace77590e2ce4207efe8 2023-09-28 09:02:19,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 73ef00c40f86e6757c56d65afe439aba 2023-09-28 09:02:19,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6f80ccbc58e4ace77590e2ce4207efe8 2023-09-28 09:02:19,771 INFO [StoreOpener-6f80ccbc58e4ace77590e2ce4207efe8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6f80ccbc58e4ace77590e2ce4207efe8 2023-09-28 09:02:19,771 INFO [StoreOpener-73ef00c40f86e6757c56d65afe439aba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 73ef00c40f86e6757c56d65afe439aba 2023-09-28 09:02:19,772 DEBUG [StoreOpener-73ef00c40f86e6757c56d65afe439aba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion/73ef00c40f86e6757c56d65afe439aba/cf 2023-09-28 09:02:19,772 DEBUG [StoreOpener-6f80ccbc58e4ace77590e2ce4207efe8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f80ccbc58e4ace77590e2ce4207efe8/cf 2023-09-28 09:02:19,772 DEBUG [StoreOpener-73ef00c40f86e6757c56d65afe439aba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion/73ef00c40f86e6757c56d65afe439aba/cf 2023-09-28 09:02:19,772 DEBUG [StoreOpener-6f80ccbc58e4ace77590e2ce4207efe8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f80ccbc58e4ace77590e2ce4207efe8/cf 2023-09-28 09:02:19,773 INFO [StoreOpener-6f80ccbc58e4ace77590e2ce4207efe8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6f80ccbc58e4ace77590e2ce4207efe8 columnFamilyName cf 2023-09-28 09:02:19,773 INFO [StoreOpener-73ef00c40f86e6757c56d65afe439aba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 73ef00c40f86e6757c56d65afe439aba columnFamilyName cf 2023-09-28 09:02:19,775 INFO [StoreOpener-6f80ccbc58e4ace77590e2ce4207efe8-1] regionserver.HStore(310): Store=6f80ccbc58e4ace77590e2ce4207efe8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 09:02:19,775 INFO [StoreOpener-73ef00c40f86e6757c56d65afe439aba-1] regionserver.HStore(310): Store=73ef00c40f86e6757c56d65afe439aba/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 09:02:19,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f80ccbc58e4ace77590e2ce4207efe8 2023-09-28 09:02:19,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion/73ef00c40f86e6757c56d65afe439aba 2023-09-28 09:02:19,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f80ccbc58e4ace77590e2ce4207efe8 2023-09-28 09:02:19,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion/73ef00c40f86e6757c56d65afe439aba 2023-09-28 09:02:19,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 73ef00c40f86e6757c56d65afe439aba 2023-09-28 09:02:19,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6f80ccbc58e4ace77590e2ce4207efe8 2023-09-28 09:02:19,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion/73ef00c40f86e6757c56d65afe439aba/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 09:02:19,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f80ccbc58e4ace77590e2ce4207efe8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 09:02:19,782 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 73ef00c40f86e6757c56d65afe439aba; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66208624, jitterRate=-0.013414621353149414}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 09:02:19,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 73ef00c40f86e6757c56d65afe439aba: 2023-09-28 09:02:19,783 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6f80ccbc58e4ace77590e2ce4207efe8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68757122, jitterRate=0.02456095814704895}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 09:02:19,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6f80ccbc58e4ace77590e2ce4207efe8: 2023-09-28 09:02:19,783 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1695891739392.73ef00c40f86e6757c56d65afe439aba., pid=60, masterSystemTime=1695891739763 2023-09-28 09:02:19,783 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1695891739392.6f80ccbc58e4ace77590e2ce4207efe8., pid=61, masterSystemTime=1695891739763 2023-09-28 09:02:19,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1695891739392.73ef00c40f86e6757c56d65afe439aba. 2023-09-28 09:02:19,785 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1695891739392.73ef00c40f86e6757c56d65afe439aba. 2023-09-28 09:02:19,786 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=73ef00c40f86e6757c56d65afe439aba, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:19,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1695891739392.6f80ccbc58e4ace77590e2ce4207efe8. 2023-09-28 09:02:19,786 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1695891739392.6f80ccbc58e4ace77590e2ce4207efe8. 2023-09-28 09:02:19,786 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695891739392.73ef00c40f86e6757c56d65afe439aba.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695891739785"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695891739785"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695891739785"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695891739785"}]},"ts":"1695891739785"} 2023-09-28 09:02:19,787 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=6f80ccbc58e4ace77590e2ce4207efe8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:19,787 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695891739392.6f80ccbc58e4ace77590e2ce4207efe8.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695891739786"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695891739786"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695891739786"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695891739786"}]},"ts":"1695891739786"} 2023-09-28 09:02:19,790 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=58 2023-09-28 09:02:19,790 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure 73ef00c40f86e6757c56d65afe439aba, server=jenkins-hbase4.apache.org,40311,1695891668959 in 178 msec 2023-09-28 09:02:19,791 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=59 2023-09-28 09:02:19,791 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure 6f80ccbc58e4ace77590e2ce4207efe8, server=jenkins-hbase4.apache.org,40045,1695891669000 in 178 msec 2023-09-28 09:02:19,791 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=73ef00c40f86e6757c56d65afe439aba, ASSIGN in 338 msec 2023-09-28 09:02:19,793 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=59, resume processing ppid=57 2023-09-28 09:02:19,793 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6f80ccbc58e4ace77590e2ce4207efe8, ASSIGN in 339 msec 2023-09-28 09:02:19,794 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-28 09:02:19,794 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695891739794"}]},"ts":"1695891739794"} 2023-09-28 09:02:19,795 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-09-28 09:02:19,797 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-09-28 09:02:19,797 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-09-28 09:02:19,799 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40311] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-28 09:02:19,800 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 09:02:19,801 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 09:02:19,800 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 09:02:19,800 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 09:02:19,802 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-28 09:02:19,802 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-28 09:02:19,802 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-28 09:02:19,802 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-28 09:02:19,804 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 410 msec 2023-09-28 09:02:20,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-28 09:02:20,000 INFO [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-09-28 09:02:20,002 DEBUG [Listener at jenkins-hbase4.apache.org/39071] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,002 DEBUG [Listener at jenkins-hbase4.apache.org/39071] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695891739392.73ef00c40f86e6757c56d65afe439aba. 2023-09-28 09:02:20,004 INFO [Listener at jenkins-hbase4.apache.org/39071] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-28 09:02:20,015 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-28 09:02:20,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695891740015 (current time:1695891740015). 2023-09-28 09:02:20,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-28 09:02:20,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] zookeeper.ReadOnlyZKClient(139): Connect 0x416f7ec4 to 127.0.0.1:61959 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 09:02:20,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7a0eb142, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 09:02:20,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 09:02:20,027 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39792, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 09:02:20,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x416f7ec4 to 127.0.0.1:61959 2023-09-28 09:02:20,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 09:02:20,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] zookeeper.ReadOnlyZKClient(139): Connect 0x6f27bfa5 to 127.0.0.1:61959 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 09:02:20,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@558465db, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 09:02:20,035 DEBUG [hconnection-0x5a8f5a88-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 09:02:20,037 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39796, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 09:02:20,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6f27bfa5 to 127.0.0.1:61959 2023-09-28 09:02:20,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 09:02:20,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-28 09:02:20,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-28 09:02:20,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-28 09:02:20,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-28 09:02:20,045 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-28 09:02:20,045 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695892340045 2023-09-28 09:02:20,045 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-28 09:02:20,046 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-28 09:02:20,047 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-28 09:02:20,047 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-28 09:02:20,047 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-28 09:02:20,049 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-09-28 09:02:20,049 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-28 09:02:20,050 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695892340050 2023-09-28 09:02:20,058 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,058 INFO [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-28 09:02:20,058 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 09:02:20,059 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-28 09:02:20,059 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-28 09:02:20,060 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,060 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,062 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:02:20,062 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:02:20,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:02:20,062 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:20,062 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:02:20,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:02:20,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:02:20,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:02:20,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:02:20,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:02:20,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,063 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:20,063 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:20,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,063 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,063 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:20,063 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,063 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-28 09:02:20,063 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-28 09:02:20,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-28 09:02:20,064 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-28 09:02:20,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-28 09:02:20,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,064 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,064 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-28 09:02:20,064 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-28 09:02:20,064 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 09:02:20,064 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-28 09:02:20,064 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,064 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-28 09:02:20,065 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-28 09:02:20,065 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-28 09:02:20,065 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 09:02:20,065 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,066 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-28 09:02:20,066 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-28 09:02:20,066 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 09:02:20,066 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-28 09:02:20,067 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-28 09:02:20,067 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-28 09:02:20,065 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40311,1695891668959' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-28 09:02:20,067 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40045,1695891669000' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-28 09:02:20,067 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39195,1695891668910' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-28 09:02:20,069 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,069 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,069 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:20,069 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:20,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:20,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:02:20,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:02:20,069 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,069 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,069 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 09:02:20,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:02:20,070 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,070 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 09:02:20,070 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,070 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 09:02:20,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:02:20,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:20,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:20,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:20,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:02:20,071 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40045,1695891669000' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-28 09:02:20,071 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@48821187[Count = 1] remaining members to acquire global barrier 2023-09-28 09:02:20,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:20,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:02:20,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:02:20,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:02:20,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:02:20,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:20,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:20,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:20,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:02:20,073 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40311,1695891668959' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-28 09:02:20,073 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@48821187[Count = 0] remaining members to acquire global barrier 2023-09-28 09:02:20,073 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-28 09:02:20,073 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,074 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,074 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,075 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,075 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:20,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,075 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-28 09:02:20,075 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-28 09:02:20,075 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-28 09:02:20,075 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39195,1695891668910' in zk 2023-09-28 09:02:20,075 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:20,075 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-28 09:02:20,075 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-28 09:02:20,075 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 09:02:20,075 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 09:02:20,075 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 09:02:20,075 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695891739392.73ef00c40f86e6757c56d65afe439aba. 2023-09-28 09:02:20,075 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695891739392.6f80ccbc58e4ace77590e2ce4207efe8. 2023-09-28 09:02:20,075 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695891739392.73ef00c40f86e6757c56d65afe439aba. started... 2023-09-28 09:02:20,075 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695891739392.6f80ccbc58e4ace77590e2ce4207efe8. started... 2023-09-28 09:02:20,075 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 09:02:20,076 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 73ef00c40f86e6757c56d65afe439aba: 2023-09-28 09:02:20,076 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6f80ccbc58e4ace77590e2ce4207efe8: 2023-09-28 09:02:20,077 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695891739392.6f80ccbc58e4ace77590e2ce4207efe8.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,077 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695891739392.73ef00c40f86e6757c56d65afe439aba.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,077 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 09:02:20,077 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 09:02:20,077 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-28 09:02:20,077 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-28 09:02:20,085 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695891739392.73ef00c40f86e6757c56d65afe439aba. completed. 2023-09-28 09:02:20,086 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695891739392.73ef00c40f86e6757c56d65afe439aba. 2023-09-28 09:02:20,086 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 09:02:20,086 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 09:02:20,086 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695891739392.6f80ccbc58e4ace77590e2ce4207efe8. completed. 2023-09-28 09:02:20,086 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695891739392.6f80ccbc58e4ace77590e2ce4207efe8. 2023-09-28 09:02:20,086 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:20,086 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 09:02:20,086 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 09:02:20,086 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:20,086 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-28 09:02:20,086 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-28 09:02:20,086 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40045,1695891669000' in zk 2023-09-28 09:02:20,086 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40311,1695891668959' in zk 2023-09-28 09:02:20,090 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-28 09:02:20,090 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 09:02:20,090 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-28 09:02:20,093 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-28 09:02:20,093 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-28 09:02:20,093 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 09:02:20,093 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:20,093 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-28 09:02:20,094 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:20,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:20,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:02:20,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:02:20,093 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 09:02:20,094 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-28 09:02:20,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:02:20,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:02:20,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:20,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:20,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:20,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:02:20,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:20,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:20,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:20,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40311,1695891668959': 2023-09-28 09:02:20,098 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40311,1695891668959' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-28 09:02:20,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:20,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:02:20,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:02:20,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:02:20,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:02:20,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:20,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:20,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:20,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:02:20,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:20,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:20,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:20,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40045,1695891669000': 2023-09-28 09:02:20,102 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40045,1695891669000' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-28 09:02:20,102 INFO [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-28 09:02:20,102 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-28 09:02:20,102 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-28 09:02:20,102 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,102 INFO [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-28 09:02:20,104 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,104 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,104 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:02:20,104 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,104 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:02:20,104 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:20,104 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:02:20,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,104 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:02:20,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:02:20,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,105 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:20,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:02:20,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:02:20,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:02:20,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:02:20,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:02:20,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:02:20,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:02:20,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,105 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:20,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:02:20,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:20,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:20,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:20,107 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:20,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:02:20,107 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:20,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,108 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:20,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:20,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:20,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:20,111 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:02:20,111 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:20,111 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:02:20,111 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:02:20,111 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:02:20,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:02:20,111 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:02:20,111 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:20,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:02:20,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:02:20,111 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:20,112 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,112 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:20,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:02:20,112 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:02:20,112 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:20,112 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:02:20,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:02:20,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:02:20,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:02:20,112 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:02:20,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:02:20,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:02:20,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:02:20,113 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:20,113 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,113 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,113 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 09:02:20,113 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,113 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,114 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,114 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-28 09:02:20,115 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-28 09:02:20,122 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,123 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,140 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,140 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-28 09:02:20,140 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,141 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,141 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695891740045Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695891740122 (+77 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695891740122Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695891740122Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695891740125 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695891740134 (+9 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695891740140 (+6 ms) 2023-09-28 09:02:20,143 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-28 09:02:20,144 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 97 msec 2023-09-28 09:02:20,147 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 09:02:20,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-28 09:02:20,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-28 09:02:20,150 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1695891739392.73ef00c40f86e6757c56d65afe439aba. with WAL disabled. Data may be lost in the event of a crash. 2023-09-28 09:02:20,151 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40045] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1695891739392.6f80ccbc58e4ace77590e2ce4207efe8. with WAL disabled. Data may be lost in the event of a crash. 2023-09-28 09:02:20,154 DEBUG [Listener at jenkins-hbase4.apache.org/39071] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,154 DEBUG [Listener at jenkins-hbase4.apache.org/39071] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695891739392.73ef00c40f86e6757c56d65afe439aba. 2023-09-28 09:02:20,154 INFO [Listener at jenkins-hbase4.apache.org/39071] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-28 09:02:20,164 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-28 09:02:20,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695891740164 (current time:1695891740164). 2023-09-28 09:02:20,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-28 09:02:20,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] zookeeper.ReadOnlyZKClient(139): Connect 0x7a465218 to 127.0.0.1:61959 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 09:02:20,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4eddea00, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 09:02:20,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 09:02:20,175 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39798, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 09:02:20,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7a465218 to 127.0.0.1:61959 2023-09-28 09:02:20,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 09:02:20,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] zookeeper.ReadOnlyZKClient(139): Connect 0x5800673a to 127.0.0.1:61959 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 09:02:20,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@101e28b0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 09:02:20,183 DEBUG [hconnection-0x31325d59-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 09:02:20,185 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39810, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 09:02:20,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5800673a to 127.0.0.1:61959 2023-09-28 09:02:20,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 09:02:20,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-28 09:02:20,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-28 09:02:20,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-28 09:02:20,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-28 09:02:20,194 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-28 09:02:20,194 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695892340194 2023-09-28 09:02:20,194 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-28 09:02:20,196 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-28 09:02:20,196 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-28 09:02:20,196 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-28 09:02:20,197 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-28 09:02:20,198 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-09-28 09:02:20,199 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-28 09:02:20,199 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695892340199 2023-09-28 09:02:20,207 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,207 INFO [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-28 09:02:20,207 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 09:02:20,208 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-28 09:02:20,208 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-28 09:02:20,209 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,209 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,211 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:02:20,211 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:02:20,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:02:20,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:02:20,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:02:20,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:02:20,211 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:02:20,211 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:20,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:02:20,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:02:20,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,211 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:20,212 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:20,212 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,212 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,212 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,212 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:20,212 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-28 09:02:20,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-28 09:02:20,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-28 09:02:20,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-28 09:02:20,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,212 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-28 09:02:20,212 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-28 09:02:20,213 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-28 09:02:20,213 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,213 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-28 09:02:20,213 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 09:02:20,214 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-28 09:02:20,214 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-28 09:02:20,214 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,214 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40311,1695891668959' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-28 09:02:20,214 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-28 09:02:20,214 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 09:02:20,214 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,215 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-28 09:02:20,215 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-28 09:02:20,215 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 09:02:20,215 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-28 09:02:20,216 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-28 09:02:20,216 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40045,1695891669000' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-28 09:02:20,216 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-28 09:02:20,216 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39195,1695891668910' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-28 09:02:20,217 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:20,217 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:20,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:02:20,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:02:20,218 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,218 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 09:02:20,218 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,219 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:20,219 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:02:20,219 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,219 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 09:02:20,219 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:02:20,219 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 09:02:20,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:20,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:20,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:20,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:02:20,221 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40311,1695891668959' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-28 09:02:20,221 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d279c1e[Count = 1] remaining members to acquire global barrier 2023-09-28 09:02:20,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:20,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:02:20,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:02:20,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:02:20,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:02:20,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:20,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:20,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:20,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:02:20,223 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40045,1695891669000' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-28 09:02:20,223 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d279c1e[Count = 0] remaining members to acquire global barrier 2023-09-28 09:02:20,223 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-28 09:02:20,223 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,225 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,225 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,225 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,225 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:20,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,225 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-28 09:02:20,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,225 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 09:02:20,225 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-28 09:02:20,225 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 09:02:20,225 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695891739392.6f80ccbc58e4ace77590e2ce4207efe8. 2023-09-28 09:02:20,225 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:20,225 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695891739392.6f80ccbc58e4ace77590e2ce4207efe8. started... 2023-09-28 09:02:20,225 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-28 09:02:20,225 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-28 09:02:20,225 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-28 09:02:20,226 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39195,1695891668910' in zk 2023-09-28 09:02:20,226 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 09:02:20,226 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 09:02:20,226 INFO [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6f80ccbc58e4ace77590e2ce4207efe8 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-28 09:02:20,226 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695891739392.73ef00c40f86e6757c56d65afe439aba. 2023-09-28 09:02:20,226 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695891739392.73ef00c40f86e6757c56d65afe439aba. started... 2023-09-28 09:02:20,226 INFO [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 73ef00c40f86e6757c56d65afe439aba 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-28 09:02:20,227 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-28 09:02:20,227 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 09:02:20,227 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-28 09:02:20,247 INFO [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023092818dea5b2c0f44e438698152392fd4a98 to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023092818dea5b2c0f44e438698152392fd4a98 2023-09-28 09:02:20,247 INFO [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230928ae7d40d3b62347dc9a0ddb30bcbb4fbd to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230928ae7d40d3b62347dc9a0ddb30bcbb4fbd 2023-09-28 09:02:20,254 INFO [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f80ccbc58e4ace77590e2ce4207efe8/.tmp/cf/60deed8b5a94456dbcede90b15fa93bc 2023-09-28 09:02:20,254 INFO [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion/73ef00c40f86e6757c56d65afe439aba/.tmp/cf/2fadcb180fcf4deb8fe8ae2e9e524e5a 2023-09-28 09:02:20,259 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion/73ef00c40f86e6757c56d65afe439aba/.tmp/cf/2fadcb180fcf4deb8fe8ae2e9e524e5a as hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion/73ef00c40f86e6757c56d65afe439aba/cf/2fadcb180fcf4deb8fe8ae2e9e524e5a 2023-09-28 09:02:20,259 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f80ccbc58e4ace77590e2ce4207efe8/.tmp/cf/60deed8b5a94456dbcede90b15fa93bc as hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f80ccbc58e4ace77590e2ce4207efe8/cf/60deed8b5a94456dbcede90b15fa93bc 2023-09-28 09:02:20,264 INFO [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion/73ef00c40f86e6757c56d65afe439aba/cf/2fadcb180fcf4deb8fe8ae2e9e524e5a, entries=4, sequenceid=6, filesize=5.6 K 2023-09-28 09:02:20,264 INFO [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f80ccbc58e4ace77590e2ce4207efe8/cf/60deed8b5a94456dbcede90b15fa93bc, entries=46, sequenceid=6, filesize=13.3 K 2023-09-28 09:02:20,265 INFO [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 73ef00c40f86e6757c56d65afe439aba in 39ms, sequenceid=6, compaction requested=false 2023-09-28 09:02:20,265 INFO [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 6f80ccbc58e4ace77590e2ce4207efe8 in 38ms, sequenceid=6, compaction requested=false 2023-09-28 09:02:20,265 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-28 09:02:20,265 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-28 09:02:20,267 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 73ef00c40f86e6757c56d65afe439aba: 2023-09-28 09:02:20,267 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6f80ccbc58e4ace77590e2ce4207efe8: 2023-09-28 09:02:20,268 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695891739392.73ef00c40f86e6757c56d65afe439aba.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,268 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695891739392.6f80ccbc58e4ace77590e2ce4207efe8.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,268 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 09:02:20,268 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 09:02:20,268 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion/73ef00c40f86e6757c56d65afe439aba/cf/2fadcb180fcf4deb8fe8ae2e9e524e5a] hfiles 2023-09-28 09:02:20,268 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f80ccbc58e4ace77590e2ce4207efe8/cf/60deed8b5a94456dbcede90b15fa93bc] hfiles 2023-09-28 09:02:20,268 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion/73ef00c40f86e6757c56d65afe439aba/cf/2fadcb180fcf4deb8fe8ae2e9e524e5a for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,268 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f80ccbc58e4ace77590e2ce4207efe8/cf/60deed8b5a94456dbcede90b15fa93bc for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,275 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695891739392.73ef00c40f86e6757c56d65afe439aba. completed. 2023-09-28 09:02:20,275 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695891739392.73ef00c40f86e6757c56d65afe439aba. 2023-09-28 09:02:20,275 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695891739392.6f80ccbc58e4ace77590e2ce4207efe8. completed. 2023-09-28 09:02:20,275 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 09:02:20,275 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 09:02:20,275 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:20,275 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695891739392.6f80ccbc58e4ace77590e2ce4207efe8. 2023-09-28 09:02:20,275 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-28 09:02:20,275 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40311,1695891668959' in zk 2023-09-28 09:02:20,275 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 09:02:20,275 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 09:02:20,275 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:20,275 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-28 09:02:20,275 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40045,1695891669000' in zk 2023-09-28 09:02:20,277 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:20,277 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-28 09:02:20,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:20,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:02:20,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:02:20,277 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 09:02:20,277 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-28 09:02:20,277 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:20,278 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 09:02:20,277 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-28 09:02:20,278 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-28 09:02:20,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:02:20,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:02:20,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:20,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:20,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:20,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:02:20,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:20,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:20,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:20,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40311,1695891668959': 2023-09-28 09:02:20,282 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40311,1695891668959' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-28 09:02:20,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:20,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:02:20,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:02:20,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:02:20,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:02:20,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:20,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:20,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:20,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:02:20,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:20,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:20,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:20,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40045,1695891669000': 2023-09-28 09:02:20,285 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40045,1695891669000' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-28 09:02:20,285 INFO [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-28 09:02:20,285 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-28 09:02:20,285 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-28 09:02:20,285 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,285 INFO [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-28 09:02:20,291 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,291 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:02:20,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:02:20,291 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:02:20,291 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,291 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,291 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:02:20,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:02:20,292 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:20,291 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:02:20,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:02:20,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:02:20,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,292 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:20,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:02:20,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:02:20,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:02:20,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:02:20,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:02:20,292 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:20,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:20,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:20,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:20,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:02:20,294 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:20,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,294 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:20,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:20,295 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:20,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:20,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:20,296 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 09:02:20,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-28 09:02:20,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-28 09:02:20,297 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-28 09:02:20,297 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:02:20,297 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:02:20,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:02:20,297 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:02:20,297 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,297 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:20,298 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:02:20,297 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:02:20,297 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 09:02:20,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:02:20,297 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:02:20,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:02:20,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:02:20,297 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:02:20,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:02:20,298 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,298 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,299 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-28 09:02:20,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:02:20,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:02:20,299 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:20,299 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:20,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:02:20,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:02:20,299 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,299 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:20,299 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,299 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:20,299 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:20,300 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,300 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,300 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023092818dea5b2c0f44e438698152392fd4a98, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230928ae7d40d3b62347dc9a0ddb30bcbb4fbd] mob files 2023-09-28 09:02:20,300 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023092818dea5b2c0f44e438698152392fd4a98 2023-09-28 09:02:20,300 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230928ae7d40d3b62347dc9a0ddb30bcbb4fbd 2023-09-28 09:02:20,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:02:20,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:02:20,307 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,308 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,327 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,328 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-28 09:02:20,328 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,328 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:20,328 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695891740195Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695891740307 (+112 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695891740307Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1695891740307Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1695891740314 (+7 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695891740321 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695891740328 (+7 ms) 2023-09-28 09:02:20,331 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-28 09:02:20,334 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 137 msec 2023-09-28 09:02:20,497 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 09:02:20,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-28 09:02:20,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-28 09:02:20,527 DEBUG [Listener at jenkins-hbase4.apache.org/39071] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-28 09:02:20,532 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50924, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-28 09:02:20,534 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39195] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-28 09:02:20,534 DEBUG [Listener at jenkins-hbase4.apache.org/39071] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-28 09:02:20,536 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53910, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-28 09:02:20,537 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40045] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-28 09:02:20,537 DEBUG [Listener at jenkins-hbase4.apache.org/39071] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-28 09:02:20,541 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39818, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-28 09:02:20,541 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-28 09:02:20,543 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-28 09:02:20,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:20,545 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-09-28 09:02:20,546 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-09-28 09:02:20,546 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-28 09:02:20,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-28 09:02:20,549 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f51b7863fa47cb1fa8b77fa7d04d9e05 2023-09-28 09:02:20,549 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d95b7d4096d2ffbbd3d8b01ffd468984 2023-09-28 09:02:20,549 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f51b7863fa47cb1fa8b77fa7d04d9e05 empty. 2023-09-28 09:02:20,549 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d95b7d4096d2ffbbd3d8b01ffd468984 empty. 2023-09-28 09:02:20,550 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f51b7863fa47cb1fa8b77fa7d04d9e05 2023-09-28 09:02:20,550 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d95b7d4096d2ffbbd3d8b01ffd468984 2023-09-28 09:02:20,550 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-28 09:02:20,559 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-09-28 09:02:20,561 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => f51b7863fa47cb1fa8b77fa7d04d9e05, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695891740543.f51b7863fa47cb1fa8b77fa7d04d9e05.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp 2023-09-28 09:02:20,561 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => d95b7d4096d2ffbbd3d8b01ffd468984, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695891740543.d95b7d4096d2ffbbd3d8b01ffd468984.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp 2023-09-28 09:02:20,568 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695891740543.f51b7863fa47cb1fa8b77fa7d04d9e05.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 09:02:20,568 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing f51b7863fa47cb1fa8b77fa7d04d9e05, disabling compactions & flushes 2023-09-28 09:02:20,568 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695891740543.f51b7863fa47cb1fa8b77fa7d04d9e05. 2023-09-28 09:02:20,568 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695891740543.f51b7863fa47cb1fa8b77fa7d04d9e05. 2023-09-28 09:02:20,568 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695891740543.f51b7863fa47cb1fa8b77fa7d04d9e05. after waiting 0 ms 2023-09-28 09:02:20,568 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695891740543.f51b7863fa47cb1fa8b77fa7d04d9e05. 2023-09-28 09:02:20,568 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695891740543.f51b7863fa47cb1fa8b77fa7d04d9e05. 2023-09-28 09:02:20,568 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for f51b7863fa47cb1fa8b77fa7d04d9e05: 2023-09-28 09:02:20,569 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695891740543.d95b7d4096d2ffbbd3d8b01ffd468984.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 09:02:20,569 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing d95b7d4096d2ffbbd3d8b01ffd468984, disabling compactions & flushes 2023-09-28 09:02:20,569 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695891740543.d95b7d4096d2ffbbd3d8b01ffd468984. 2023-09-28 09:02:20,569 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695891740543.d95b7d4096d2ffbbd3d8b01ffd468984. 2023-09-28 09:02:20,569 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695891740543.d95b7d4096d2ffbbd3d8b01ffd468984. after waiting 0 ms 2023-09-28 09:02:20,569 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695891740543.d95b7d4096d2ffbbd3d8b01ffd468984. 2023-09-28 09:02:20,569 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695891740543.d95b7d4096d2ffbbd3d8b01ffd468984. 2023-09-28 09:02:20,569 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for d95b7d4096d2ffbbd3d8b01ffd468984: 2023-09-28 09:02:20,571 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-09-28 09:02:20,572 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695891740543.f51b7863fa47cb1fa8b77fa7d04d9e05.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695891740572"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695891740572"}]},"ts":"1695891740572"} 2023-09-28 09:02:20,572 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695891740543.d95b7d4096d2ffbbd3d8b01ffd468984.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695891740572"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695891740572"}]},"ts":"1695891740572"} 2023-09-28 09:02:20,574 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-28 09:02:20,575 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-28 09:02:20,575 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695891740575"}]},"ts":"1695891740575"} 2023-09-28 09:02:20,576 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-09-28 09:02:20,580 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-28 09:02:20,581 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-28 09:02:20,581 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-28 09:02:20,581 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-28 09:02:20,581 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-28 09:02:20,581 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f51b7863fa47cb1fa8b77fa7d04d9e05, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d95b7d4096d2ffbbd3d8b01ffd468984, ASSIGN}] 2023-09-28 09:02:20,584 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f51b7863fa47cb1fa8b77fa7d04d9e05, ASSIGN 2023-09-28 09:02:20,584 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d95b7d4096d2ffbbd3d8b01ffd468984, ASSIGN 2023-09-28 09:02:20,585 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f51b7863fa47cb1fa8b77fa7d04d9e05, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40311,1695891668959; forceNewPlan=false, retain=false 2023-09-28 09:02:20,585 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d95b7d4096d2ffbbd3d8b01ffd468984, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39195,1695891668910; forceNewPlan=false, retain=false 2023-09-28 09:02:20,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-28 09:02:20,735 INFO [jenkins-hbase4:40293] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-28 09:02:20,738 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=d95b7d4096d2ffbbd3d8b01ffd468984, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:20,738 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=f51b7863fa47cb1fa8b77fa7d04d9e05, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:20,738 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695891740543.d95b7d4096d2ffbbd3d8b01ffd468984.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695891740738"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695891740738"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695891740738"}]},"ts":"1695891740738"} 2023-09-28 09:02:20,738 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695891740543.f51b7863fa47cb1fa8b77fa7d04d9e05.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695891740738"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695891740738"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695891740738"}]},"ts":"1695891740738"} 2023-09-28 09:02:20,740 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure d95b7d4096d2ffbbd3d8b01ffd468984, server=jenkins-hbase4.apache.org,39195,1695891668910}] 2023-09-28 09:02:20,741 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure f51b7863fa47cb1fa8b77fa7d04d9e05, server=jenkins-hbase4.apache.org,40311,1695891668959}] 2023-09-28 09:02:20,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-28 09:02:20,896 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1695891740543.d95b7d4096d2ffbbd3d8b01ffd468984. 2023-09-28 09:02:20,896 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695891740543.f51b7863fa47cb1fa8b77fa7d04d9e05. 2023-09-28 09:02:20,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d95b7d4096d2ffbbd3d8b01ffd468984, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695891740543.d95b7d4096d2ffbbd3d8b01ffd468984.', STARTKEY => '2', ENDKEY => ''} 2023-09-28 09:02:20,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f51b7863fa47cb1fa8b77fa7d04d9e05, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695891740543.f51b7863fa47cb1fa8b77fa7d04d9e05.', STARTKEY => '', ENDKEY => '2'} 2023-09-28 09:02:20,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1695891740543.d95b7d4096d2ffbbd3d8b01ffd468984. service=AccessControlService 2023-09-28 09:02:20,896 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 09:02:20,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 d95b7d4096d2ffbbd3d8b01ffd468984 2023-09-28 09:02:20,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695891740543.d95b7d4096d2ffbbd3d8b01ffd468984.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 09:02:20,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d95b7d4096d2ffbbd3d8b01ffd468984 2023-09-28 09:02:20,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d95b7d4096d2ffbbd3d8b01ffd468984 2023-09-28 09:02:20,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695891740543.f51b7863fa47cb1fa8b77fa7d04d9e05. service=AccessControlService 2023-09-28 09:02:20,897 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 09:02:20,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 f51b7863fa47cb1fa8b77fa7d04d9e05 2023-09-28 09:02:20,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695891740543.f51b7863fa47cb1fa8b77fa7d04d9e05.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 09:02:20,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f51b7863fa47cb1fa8b77fa7d04d9e05 2023-09-28 09:02:20,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f51b7863fa47cb1fa8b77fa7d04d9e05 2023-09-28 09:02:20,898 INFO [StoreOpener-d95b7d4096d2ffbbd3d8b01ffd468984-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d95b7d4096d2ffbbd3d8b01ffd468984 2023-09-28 09:02:20,898 INFO [StoreOpener-f51b7863fa47cb1fa8b77fa7d04d9e05-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f51b7863fa47cb1fa8b77fa7d04d9e05 2023-09-28 09:02:20,899 DEBUG [StoreOpener-d95b7d4096d2ffbbd3d8b01ffd468984-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d95b7d4096d2ffbbd3d8b01ffd468984/cf 2023-09-28 09:02:20,899 DEBUG [StoreOpener-d95b7d4096d2ffbbd3d8b01ffd468984-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d95b7d4096d2ffbbd3d8b01ffd468984/cf 2023-09-28 09:02:20,899 DEBUG [StoreOpener-f51b7863fa47cb1fa8b77fa7d04d9e05-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f51b7863fa47cb1fa8b77fa7d04d9e05/cf 2023-09-28 09:02:20,900 DEBUG [StoreOpener-f51b7863fa47cb1fa8b77fa7d04d9e05-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f51b7863fa47cb1fa8b77fa7d04d9e05/cf 2023-09-28 09:02:20,900 INFO [StoreOpener-d95b7d4096d2ffbbd3d8b01ffd468984-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d95b7d4096d2ffbbd3d8b01ffd468984 columnFamilyName cf 2023-09-28 09:02:20,900 INFO [StoreOpener-f51b7863fa47cb1fa8b77fa7d04d9e05-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f51b7863fa47cb1fa8b77fa7d04d9e05 columnFamilyName cf 2023-09-28 09:02:20,900 INFO [StoreOpener-d95b7d4096d2ffbbd3d8b01ffd468984-1] regionserver.HStore(310): Store=d95b7d4096d2ffbbd3d8b01ffd468984/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 09:02:20,900 INFO [StoreOpener-f51b7863fa47cb1fa8b77fa7d04d9e05-1] regionserver.HStore(310): Store=f51b7863fa47cb1fa8b77fa7d04d9e05/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 09:02:20,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d95b7d4096d2ffbbd3d8b01ffd468984 2023-09-28 09:02:20,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f51b7863fa47cb1fa8b77fa7d04d9e05 2023-09-28 09:02:20,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d95b7d4096d2ffbbd3d8b01ffd468984 2023-09-28 09:02:20,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f51b7863fa47cb1fa8b77fa7d04d9e05 2023-09-28 09:02:20,904 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d95b7d4096d2ffbbd3d8b01ffd468984 2023-09-28 09:02:20,904 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f51b7863fa47cb1fa8b77fa7d04d9e05 2023-09-28 09:02:20,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d95b7d4096d2ffbbd3d8b01ffd468984/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 09:02:20,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f51b7863fa47cb1fa8b77fa7d04d9e05/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 09:02:20,906 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f51b7863fa47cb1fa8b77fa7d04d9e05; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64216427, jitterRate=-0.04310066998004913}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 09:02:20,907 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d95b7d4096d2ffbbd3d8b01ffd468984; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66131959, jitterRate=-0.014557018876075745}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 09:02:20,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f51b7863fa47cb1fa8b77fa7d04d9e05: 2023-09-28 09:02:20,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d95b7d4096d2ffbbd3d8b01ffd468984: 2023-09-28 09:02:20,907 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695891740543.f51b7863fa47cb1fa8b77fa7d04d9e05., pid=70, masterSystemTime=1695891740893 2023-09-28 09:02:20,909 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695891740543.d95b7d4096d2ffbbd3d8b01ffd468984., pid=69, masterSystemTime=1695891740892 2023-09-28 09:02:20,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695891740543.f51b7863fa47cb1fa8b77fa7d04d9e05. 2023-09-28 09:02:20,910 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695891740543.f51b7863fa47cb1fa8b77fa7d04d9e05. 2023-09-28 09:02:20,911 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=f51b7863fa47cb1fa8b77fa7d04d9e05, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:20,911 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695891740543.f51b7863fa47cb1fa8b77fa7d04d9e05.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695891740911"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695891740911"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695891740911"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695891740911"}]},"ts":"1695891740911"} 2023-09-28 09:02:20,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695891740543.d95b7d4096d2ffbbd3d8b01ffd468984. 2023-09-28 09:02:20,911 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1695891740543.d95b7d4096d2ffbbd3d8b01ffd468984. 2023-09-28 09:02:20,911 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=d95b7d4096d2ffbbd3d8b01ffd468984, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:20,912 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695891740543.d95b7d4096d2ffbbd3d8b01ffd468984.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695891740911"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695891740911"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695891740911"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695891740911"}]},"ts":"1695891740911"} 2023-09-28 09:02:20,914 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=67 2023-09-28 09:02:20,914 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure f51b7863fa47cb1fa8b77fa7d04d9e05, server=jenkins-hbase4.apache.org,40311,1695891668959 in 171 msec 2023-09-28 09:02:20,915 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=68 2023-09-28 09:02:20,915 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure d95b7d4096d2ffbbd3d8b01ffd468984, server=jenkins-hbase4.apache.org,39195,1695891668910 in 173 msec 2023-09-28 09:02:20,916 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f51b7863fa47cb1fa8b77fa7d04d9e05, ASSIGN in 333 msec 2023-09-28 09:02:20,917 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=68, resume processing ppid=66 2023-09-28 09:02:20,917 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d95b7d4096d2ffbbd3d8b01ffd468984, ASSIGN in 334 msec 2023-09-28 09:02:20,918 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-28 09:02:20,918 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695891740918"}]},"ts":"1695891740918"} 2023-09-28 09:02:20,919 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-09-28 09:02:20,921 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-09-28 09:02:20,921 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-09-28 09:02:20,923 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40311] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-28 09:02:20,924 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 09:02:20,925 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 09:02:20,925 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 09:02:20,924 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 09:02:20,926 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-28 09:02:20,927 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-28 09:02:20,927 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-28 09:02:20,927 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-28 09:02:20,927 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-28 09:02:20,927 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-28 09:02:20,927 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-28 09:02:20,927 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-28 09:02:20,928 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 383 msec 2023-09-28 09:02:21,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-28 09:02:21,150 INFO [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-09-28 09:02:21,171 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions f51b7863fa47cb1fa8b77fa7d04d9e05, d95b7d4096d2ffbbd3d8b01ffd468984 2023-09-28 09:02:21,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[f51b7863fa47cb1fa8b77fa7d04d9e05, d95b7d4096d2ffbbd3d8b01ffd468984], force=true 2023-09-28 09:02:21,182 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[f51b7863fa47cb1fa8b77fa7d04d9e05, d95b7d4096d2ffbbd3d8b01ffd468984], force=true 2023-09-28 09:02:21,182 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[f51b7863fa47cb1fa8b77fa7d04d9e05, d95b7d4096d2ffbbd3d8b01ffd468984], force=true 2023-09-28 09:02:21,182 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[f51b7863fa47cb1fa8b77fa7d04d9e05, d95b7d4096d2ffbbd3d8b01ffd468984], force=true 2023-09-28 09:02:21,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-28 09:02:21,203 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f51b7863fa47cb1fa8b77fa7d04d9e05, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d95b7d4096d2ffbbd3d8b01ffd468984, UNASSIGN}] 2023-09-28 09:02:21,205 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f51b7863fa47cb1fa8b77fa7d04d9e05, UNASSIGN 2023-09-28 09:02:21,205 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d95b7d4096d2ffbbd3d8b01ffd468984, UNASSIGN 2023-09-28 09:02:21,206 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=f51b7863fa47cb1fa8b77fa7d04d9e05, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:21,206 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=d95b7d4096d2ffbbd3d8b01ffd468984, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:21,206 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695891740543.f51b7863fa47cb1fa8b77fa7d04d9e05.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695891741206"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695891741206"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695891741206"}]},"ts":"1695891741206"} 2023-09-28 09:02:21,206 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695891740543.d95b7d4096d2ffbbd3d8b01ffd468984.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695891741206"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695891741206"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695891741206"}]},"ts":"1695891741206"} 2023-09-28 09:02:21,207 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure f51b7863fa47cb1fa8b77fa7d04d9e05, server=jenkins-hbase4.apache.org,40311,1695891668959}] 2023-09-28 09:02:21,208 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure d95b7d4096d2ffbbd3d8b01ffd468984, server=jenkins-hbase4.apache.org,39195,1695891668910}] 2023-09-28 09:02:21,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-28 09:02:21,360 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f51b7863fa47cb1fa8b77fa7d04d9e05 2023-09-28 09:02:21,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f51b7863fa47cb1fa8b77fa7d04d9e05, disabling compactions & flushes 2023-09-28 09:02:21,362 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695891740543.f51b7863fa47cb1fa8b77fa7d04d9e05. 2023-09-28 09:02:21,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695891740543.f51b7863fa47cb1fa8b77fa7d04d9e05. 2023-09-28 09:02:21,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695891740543.f51b7863fa47cb1fa8b77fa7d04d9e05. after waiting 0 ms 2023-09-28 09:02:21,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695891740543.f51b7863fa47cb1fa8b77fa7d04d9e05. 2023-09-28 09:02:21,362 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing f51b7863fa47cb1fa8b77fa7d04d9e05 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-28 09:02:21,362 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d95b7d4096d2ffbbd3d8b01ffd468984 2023-09-28 09:02:21,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d95b7d4096d2ffbbd3d8b01ffd468984, disabling compactions & flushes 2023-09-28 09:02:21,364 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695891740543.d95b7d4096d2ffbbd3d8b01ffd468984. 2023-09-28 09:02:21,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695891740543.d95b7d4096d2ffbbd3d8b01ffd468984. 2023-09-28 09:02:21,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695891740543.d95b7d4096d2ffbbd3d8b01ffd468984. after waiting 0 ms 2023-09-28 09:02:21,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695891740543.d95b7d4096d2ffbbd3d8b01ffd468984. 2023-09-28 09:02:21,364 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing d95b7d4096d2ffbbd3d8b01ffd468984 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-28 09:02:21,380 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f51b7863fa47cb1fa8b77fa7d04d9e05/.tmp/cf/2bf693c1d396448f84035bdc9a91aafd 2023-09-28 09:02:21,380 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d95b7d4096d2ffbbd3d8b01ffd468984/.tmp/cf/2d6a3a3114664d8c95c019ace118257d 2023-09-28 09:02:21,387 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f51b7863fa47cb1fa8b77fa7d04d9e05/.tmp/cf/2bf693c1d396448f84035bdc9a91aafd as hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f51b7863fa47cb1fa8b77fa7d04d9e05/cf/2bf693c1d396448f84035bdc9a91aafd 2023-09-28 09:02:21,387 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d95b7d4096d2ffbbd3d8b01ffd468984/.tmp/cf/2d6a3a3114664d8c95c019ace118257d as hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d95b7d4096d2ffbbd3d8b01ffd468984/cf/2d6a3a3114664d8c95c019ace118257d 2023-09-28 09:02:21,391 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f51b7863fa47cb1fa8b77fa7d04d9e05/cf/2bf693c1d396448f84035bdc9a91aafd, entries=1, sequenceid=5, filesize=4.7 K 2023-09-28 09:02:21,392 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for f51b7863fa47cb1fa8b77fa7d04d9e05 in 30ms, sequenceid=5, compaction requested=false 2023-09-28 09:02:21,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-28 09:02:21,392 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d95b7d4096d2ffbbd3d8b01ffd468984/cf/2d6a3a3114664d8c95c019ace118257d, entries=1, sequenceid=5, filesize=4.7 K 2023-09-28 09:02:21,393 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for d95b7d4096d2ffbbd3d8b01ffd468984 in 29ms, sequenceid=5, compaction requested=false 2023-09-28 09:02:21,402 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f51b7863fa47cb1fa8b77fa7d04d9e05/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-28 09:02:21,402 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d95b7d4096d2ffbbd3d8b01ffd468984/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-28 09:02:21,402 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 09:02:21,402 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695891740543.f51b7863fa47cb1fa8b77fa7d04d9e05. 2023-09-28 09:02:21,402 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f51b7863fa47cb1fa8b77fa7d04d9e05: 2023-09-28 09:02:21,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 09:02:21,403 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695891740543.d95b7d4096d2ffbbd3d8b01ffd468984. 2023-09-28 09:02:21,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d95b7d4096d2ffbbd3d8b01ffd468984: 2023-09-28 09:02:21,404 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f51b7863fa47cb1fa8b77fa7d04d9e05 2023-09-28 09:02:21,404 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=f51b7863fa47cb1fa8b77fa7d04d9e05, regionState=CLOSED 2023-09-28 09:02:21,404 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d95b7d4096d2ffbbd3d8b01ffd468984 2023-09-28 09:02:21,404 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695891740543.f51b7863fa47cb1fa8b77fa7d04d9e05.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695891741404"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695891741404"}]},"ts":"1695891741404"} 2023-09-28 09:02:21,405 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=d95b7d4096d2ffbbd3d8b01ffd468984, regionState=CLOSED 2023-09-28 09:02:21,405 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695891740543.d95b7d4096d2ffbbd3d8b01ffd468984.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695891741405"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695891741405"}]},"ts":"1695891741405"} 2023-09-28 09:02:21,407 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=72 2023-09-28 09:02:21,408 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure f51b7863fa47cb1fa8b77fa7d04d9e05, server=jenkins-hbase4.apache.org,40311,1695891668959 in 199 msec 2023-09-28 09:02:21,409 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f51b7863fa47cb1fa8b77fa7d04d9e05, UNASSIGN in 208 msec 2023-09-28 09:02:21,410 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=73 2023-09-28 09:02:21,410 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure d95b7d4096d2ffbbd3d8b01ffd468984, server=jenkins-hbase4.apache.org,39195,1695891668910 in 200 msec 2023-09-28 09:02:21,411 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=73, resume processing ppid=71 2023-09-28 09:02:21,411 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d95b7d4096d2ffbbd3d8b01ffd468984, UNASSIGN in 207 msec 2023-09-28 09:02:21,457 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3b78e5c18844475dc961b228efcb1635/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-09-28 09:02:21,459 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695891740543.f51b7863fa47cb1fa8b77fa7d04d9e05.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-28 09:02:21,459 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695891740543.d95b7d4096d2ffbbd3d8b01ffd468984.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-28 09:02:21,459 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695891740544.3b78e5c18844475dc961b228efcb1635.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-28 09:02:21,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-28 09:02:21,507 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3b78e5c18844475dc961b228efcb1635, ASSIGN}] 2023-09-28 09:02:21,508 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3b78e5c18844475dc961b228efcb1635, ASSIGN 2023-09-28 09:02:21,508 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3b78e5c18844475dc961b228efcb1635, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,40311,1695891668959; forceNewPlan=false, retain=false 2023-09-28 09:02:21,659 INFO [jenkins-hbase4:40293] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-28 09:02:21,661 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=3b78e5c18844475dc961b228efcb1635, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:21,661 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695891740544.3b78e5c18844475dc961b228efcb1635.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695891741660"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695891741660"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695891741660"}]},"ts":"1695891741660"} 2023-09-28 09:02:21,663 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 3b78e5c18844475dc961b228efcb1635, server=jenkins-hbase4.apache.org,40311,1695891668959}] 2023-09-28 09:02:21,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-28 09:02:21,818 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695891740544.3b78e5c18844475dc961b228efcb1635. 2023-09-28 09:02:21,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3b78e5c18844475dc961b228efcb1635, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695891740544.3b78e5c18844475dc961b228efcb1635.', STARTKEY => '', ENDKEY => ''} 2023-09-28 09:02:21,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695891740544.3b78e5c18844475dc961b228efcb1635. service=AccessControlService 2023-09-28 09:02:21,818 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 09:02:21,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 3b78e5c18844475dc961b228efcb1635 2023-09-28 09:02:21,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695891740544.3b78e5c18844475dc961b228efcb1635.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 09:02:21,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3b78e5c18844475dc961b228efcb1635 2023-09-28 09:02:21,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3b78e5c18844475dc961b228efcb1635 2023-09-28 09:02:21,819 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3b78e5c18844475dc961b228efcb1635/.regioninfo 2023-09-28 09:02:21,828 INFO [StoreOpener-3b78e5c18844475dc961b228efcb1635-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3b78e5c18844475dc961b228efcb1635 2023-09-28 09:02:21,829 DEBUG [StoreOpener-3b78e5c18844475dc961b228efcb1635-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3b78e5c18844475dc961b228efcb1635/cf 2023-09-28 09:02:21,829 DEBUG [StoreOpener-3b78e5c18844475dc961b228efcb1635-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3b78e5c18844475dc961b228efcb1635/cf 2023-09-28 09:02:21,830 INFO [StoreOpener-3b78e5c18844475dc961b228efcb1635-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3b78e5c18844475dc961b228efcb1635 columnFamilyName cf 2023-09-28 09:02:21,858 DEBUG [StoreOpener-3b78e5c18844475dc961b228efcb1635-1] regionserver.HStore(539): loaded hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3b78e5c18844475dc961b228efcb1635/cf/2bf693c1d396448f84035bdc9a91aafd.f51b7863fa47cb1fa8b77fa7d04d9e05->hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f51b7863fa47cb1fa8b77fa7d04d9e05/cf/2bf693c1d396448f84035bdc9a91aafd-top 2023-09-28 09:02:21,864 DEBUG [StoreOpener-3b78e5c18844475dc961b228efcb1635-1] regionserver.HStore(539): loaded hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3b78e5c18844475dc961b228efcb1635/cf/2d6a3a3114664d8c95c019ace118257d.d95b7d4096d2ffbbd3d8b01ffd468984->hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d95b7d4096d2ffbbd3d8b01ffd468984/cf/2d6a3a3114664d8c95c019ace118257d-top 2023-09-28 09:02:21,864 INFO [StoreOpener-3b78e5c18844475dc961b228efcb1635-1] regionserver.HStore(310): Store=3b78e5c18844475dc961b228efcb1635/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 09:02:21,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3b78e5c18844475dc961b228efcb1635 2023-09-28 09:02:21,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3b78e5c18844475dc961b228efcb1635 2023-09-28 09:02:21,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3b78e5c18844475dc961b228efcb1635 2023-09-28 09:02:21,869 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3b78e5c18844475dc961b228efcb1635; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70331892, jitterRate=0.048026859760284424}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 09:02:21,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3b78e5c18844475dc961b228efcb1635: 2023-09-28 09:02:21,870 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695891740544.3b78e5c18844475dc961b228efcb1635., pid=77, masterSystemTime=1695891741814 2023-09-28 09:02:21,871 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1695891740544.3b78e5c18844475dc961b228efcb1635.,because compaction is disabled. 2023-09-28 09:02:21,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695891740544.3b78e5c18844475dc961b228efcb1635. 2023-09-28 09:02:21,872 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695891740544.3b78e5c18844475dc961b228efcb1635. 2023-09-28 09:02:21,872 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=3b78e5c18844475dc961b228efcb1635, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:21,873 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695891740544.3b78e5c18844475dc961b228efcb1635.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695891741872"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695891741872"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695891741872"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695891741872"}]},"ts":"1695891741872"} 2023-09-28 09:02:21,875 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-09-28 09:02:21,876 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 3b78e5c18844475dc961b228efcb1635, server=jenkins-hbase4.apache.org,40311,1695891668959 in 211 msec 2023-09-28 09:02:21,877 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-09-28 09:02:21,877 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3b78e5c18844475dc961b228efcb1635, ASSIGN in 369 msec 2023-09-28 09:02:21,879 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[f51b7863fa47cb1fa8b77fa7d04d9e05, d95b7d4096d2ffbbd3d8b01ffd468984], force=true in 702 msec 2023-09-28 09:02:22,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-28 09:02:22,289 INFO [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-09-28 09:02:22,290 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-28 09:02:22,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695891742290 (current time:1695891742290). 2023-09-28 09:02:22,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-28 09:02:22,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] zookeeper.ReadOnlyZKClient(139): Connect 0x37b0fea1 to 127.0.0.1:61959 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 09:02:22,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3e05f658, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 09:02:22,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 09:02:22,302 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39834, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 09:02:22,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x37b0fea1 to 127.0.0.1:61959 2023-09-28 09:02:22,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 09:02:22,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] zookeeper.ReadOnlyZKClient(139): Connect 0x3b8724b7 to 127.0.0.1:61959 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 09:02:22,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b728090, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 09:02:22,311 DEBUG [hconnection-0x1a540090-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 09:02:22,314 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39846, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 09:02:22,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3b8724b7 to 127.0.0.1:61959 2023-09-28 09:02:22,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 09:02:22,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-28 09:02:22,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-28 09:02:22,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-28 09:02:22,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-28 09:02:22,322 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-28 09:02:22,322 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1695892342322 2023-09-28 09:02:22,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-28 09:02:22,322 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,326 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-28 09:02:22,326 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-28 09:02:22,327 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-28 09:02:22,327 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-28 09:02:22,328 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 7 msec 2023-09-28 09:02:22,329 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-28 09:02:22,329 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1695892342329 2023-09-28 09:02:22,337 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,337 INFO [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-09-28 09:02:22,337 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 09:02:22,338 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-09-28 09:02:22,338 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-09-28 09:02:22,339 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,339 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,341 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:02:22,341 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:02:22,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:02:22,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:02:22,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:02:22,341 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:02:22,341 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:22,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:02:22,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:02:22,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:02:22,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,342 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:22,342 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-28 09:02:22,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,342 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,342 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,342 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-28 09:02:22,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,342 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-28 09:02:22,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-28 09:02:22,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-28 09:02:22,343 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,343 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-28 09:02:22,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,343 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-28 09:02:22,343 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 09:02:22,343 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-28 09:02:22,345 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,346 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,346 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-28 09:02:22,346 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-28 09:02:22,346 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 09:02:22,346 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-28 09:02:22,347 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-28 09:02:22,347 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-28 09:02:22,347 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-28 09:02:22,347 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40311,1695891668959' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-28 09:02:22,347 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39195,1695891668910' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-28 09:02:22,346 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 09:02:22,348 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-28 09:02:22,348 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-28 09:02:22,348 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40045,1695891669000' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-28 09:02:22,349 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,349 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,349 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:22,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:22,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:02:22,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:02:22,350 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:02:22,350 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,350 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 09:02:22,350 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,350 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 09:02:22,350 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,350 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 09:02:22,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:02:22,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:22,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:22,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:22,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:02:22,352 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40311,1695891668959' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-09-28 09:02:22,352 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5145355[Count = 0] remaining members to acquire global barrier 2023-09-28 09:02:22,352 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-09-28 09:02:22,352 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,353 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,353 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,353 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,353 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:22,353 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-28 09:02:22,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,353 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-28 09:02:22,354 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-28 09:02:22,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,354 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-28 09:02:22,354 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-28 09:02:22,354 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-28 09:02:22,354 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,40045,1695891669000' in zk 2023-09-28 09:02:22,354 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,39195,1695891668910' in zk 2023-09-28 09:02:22,354 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695891740544.3b78e5c18844475dc961b228efcb1635. 2023-09-28 09:02:22,354 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 09:02:22,354 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 09:02:22,354 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695891740544.3b78e5c18844475dc961b228efcb1635. started... 2023-09-28 09:02:22,355 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3b78e5c18844475dc961b228efcb1635: 2023-09-28 09:02:22,355 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695891740544.3b78e5c18844475dc961b228efcb1635.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,355 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 09:02:22,355 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3b78e5c18844475dc961b228efcb1635/cf/2bf693c1d396448f84035bdc9a91aafd.f51b7863fa47cb1fa8b77fa7d04d9e05->hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f51b7863fa47cb1fa8b77fa7d04d9e05/cf/2bf693c1d396448f84035bdc9a91aafd-top, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3b78e5c18844475dc961b228efcb1635/cf/2d6a3a3114664d8c95c019ace118257d.d95b7d4096d2ffbbd3d8b01ffd468984->hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d95b7d4096d2ffbbd3d8b01ffd468984/cf/2d6a3a3114664d8c95c019ace118257d-top] hfiles 2023-09-28 09:02:22,355 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3b78e5c18844475dc961b228efcb1635/cf/2bf693c1d396448f84035bdc9a91aafd.f51b7863fa47cb1fa8b77fa7d04d9e05 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,356 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3b78e5c18844475dc961b228efcb1635/cf/2d6a3a3114664d8c95c019ace118257d.d95b7d4096d2ffbbd3d8b01ffd468984 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,357 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-28 09:02:22,357 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 09:02:22,357 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-28 09:02:22,358 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-28 09:02:22,358 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 09:02:22,358 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-28 09:02:22,368 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695891740544.3b78e5c18844475dc961b228efcb1635. completed. 2023-09-28 09:02:22,368 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695891740544.3b78e5c18844475dc961b228efcb1635. 2023-09-28 09:02:22,368 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 09:02:22,368 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 09:02:22,368 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:22,368 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-28 09:02:22,368 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,40311,1695891668959' in zk 2023-09-28 09:02:22,376 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-28 09:02:22,376 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:22,376 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 09:02:22,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:22,376 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-28 09:02:22,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:02:22,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:02:22,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:02:22,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:02:22,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:22,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:22,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:22,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:02:22,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:22,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:22,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:22,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,40311,1695891668959': 2023-09-28 09:02:22,379 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40311,1695891668959' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-09-28 09:02:22,379 INFO [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-09-28 09:02:22,379 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-28 09:02:22,379 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-28 09:02:22,379 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,379 INFO [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-28 09:02:22,382 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,382 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,382 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:02:22,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:02:22,382 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:02:22,382 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,382 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,382 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:02:22,382 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:02:22,382 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:02:22,382 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,382 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:02:22,382 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:22,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:02:22,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:02:22,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:02:22,383 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:22,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:02:22,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:02:22,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:02:22,383 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:22,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:22,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:22,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:22,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:02:22,385 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:22,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,385 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:22,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:22,385 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:22,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:22,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:22,388 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:22,388 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:02:22,388 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:02:22,388 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:02:22,388 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:02:22,388 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:02:22,388 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:02:22,388 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 09:02:22,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:02:22,388 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:22,388 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:02:22,388 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:02:22,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:02:22,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:02:22,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:02:22,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:02:22,388 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:22,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:02:22,388 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,389 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:02:22,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:02:22,389 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:22,389 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:02:22,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:02:22,389 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:22,389 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:22,389 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,389 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,390 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,407 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,408 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-09-28 09:02:22,408 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,408 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,409 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1695891742323Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695891742388 (+65 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695891742389 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695891742392 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695891742399 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1695891742408 (+9 ms) 2023-09-28 09:02:22,410 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-28 09:02:22,412 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 85 msec 2023-09-28 09:02:22,426 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 09:02:22,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-09-28 09:02:22,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-28 09:02:22,427 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/export-test/export-1695891742427 2023-09-28 09:02:22,427 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:39781, tgtDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/export-test/export-1695891742427, rawTgtDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/export-test/export-1695891742427, srcFsUri=hdfs://localhost:39781, srcDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba 2023-09-28 09:02:22,450 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39781, inputRoot=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba 2023-09-28 09:02:22,450 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1971367919_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/export-test/export-1695891742427, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/export-test/export-1695891742427/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,450 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39781, inputRoot=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba, snapshotDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-09-28 09:02:22,458 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/export-test/export-1695891742427/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:22,477 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-28 09:02:22,478 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-28 09:02:22,478 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-28 09:02:22,478 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-28 09:02:23,350 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/hadoop-9086960994933473920.jar 2023-09-28 09:02:23,350 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-28 09:02:23,350 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-28 09:02:23,416 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/hadoop-5982467856011052857.jar 2023-09-28 09:02:23,417 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-28 09:02:23,418 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-28 09:02:23,418 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-28 09:02:23,419 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-28 09:02:23,419 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-28 09:02:23,419 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-28 09:02:23,420 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-28 09:02:23,421 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-28 09:02:23,421 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-28 09:02:23,422 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-28 09:02:23,422 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-28 09:02:23,423 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-28 09:02:23,423 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-28 09:02:23,423 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-28 09:02:23,424 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-28 09:02:23,424 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-28 09:02:23,425 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 09:02:23,425 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 09:02:23,426 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 09:02:23,426 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 09:02:23,426 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 09:02:23,426 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 09:02:23,427 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 09:02:23,767 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695891675416_0004_000001 (auth:SIMPLE) 2023-09-28 09:02:23,777 WARN [Listener at jenkins-hbase4.apache.org/39071] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-28 09:02:23,779 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-09-28 09:02:23,781 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-09-28 09:02:23,832 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 09:02:23,833 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 09:02:24,665 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-28 09:02:24,712 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695891675416_0005_000001 (auth:SIMPLE) 2023-09-28 09:02:28,342 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695891675416_0005_000001 (auth:SIMPLE) 2023-09-28 09:02:30,558 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695891675416_0005_000001 (auth:SIMPLE) 2023-09-28 09:02:32,898 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695891675416_0005_000001 (auth:SIMPLE) 2023-09-28 09:02:33,940 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-28 09:02:33,943 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-28 09:02:33,952 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:33,952 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-28 09:02:33,953 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-28 09:02:33,953 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1698010877_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:33,953 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(367): hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-28 09:02:33,954 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(367): hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-28 09:02:33,954 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1698010877_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/export-test/export-1695891742427/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/export-test/export-1695891742427/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:33,954 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(367): hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/export-test/export-1695891742427/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-28 09:02:33,954 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(367): hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/export-test/export-1695891742427/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-28 09:02:33,961 INFO [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:33,962 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:33,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:33,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-28 09:02:33,969 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695891753969"}]},"ts":"1695891753969"} 2023-09-28 09:02:33,970 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-09-28 09:02:33,972 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-09-28 09:02:33,973 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3b78e5c18844475dc961b228efcb1635, UNASSIGN}] 2023-09-28 09:02:33,975 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3b78e5c18844475dc961b228efcb1635, UNASSIGN 2023-09-28 09:02:33,976 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=3b78e5c18844475dc961b228efcb1635, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:33,976 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695891740544.3b78e5c18844475dc961b228efcb1635.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695891753976"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695891753976"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695891753976"}]},"ts":"1695891753976"} 2023-09-28 09:02:33,977 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 3b78e5c18844475dc961b228efcb1635, server=jenkins-hbase4.apache.org,40311,1695891668959}] 2023-09-28 09:02:34,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-28 09:02:34,129 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3b78e5c18844475dc961b228efcb1635 2023-09-28 09:02:34,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3b78e5c18844475dc961b228efcb1635, disabling compactions & flushes 2023-09-28 09:02:34,130 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695891740544.3b78e5c18844475dc961b228efcb1635. 2023-09-28 09:02:34,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695891740544.3b78e5c18844475dc961b228efcb1635. 2023-09-28 09:02:34,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695891740544.3b78e5c18844475dc961b228efcb1635. after waiting 0 ms 2023-09-28 09:02:34,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695891740544.3b78e5c18844475dc961b228efcb1635. 2023-09-28 09:02:34,141 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3b78e5c18844475dc961b228efcb1635/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-09-28 09:02:34,141 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 09:02:34,142 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695891740544.3b78e5c18844475dc961b228efcb1635. 2023-09-28 09:02:34,142 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3b78e5c18844475dc961b228efcb1635: 2023-09-28 09:02:34,143 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3b78e5c18844475dc961b228efcb1635 2023-09-28 09:02:34,144 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=3b78e5c18844475dc961b228efcb1635, regionState=CLOSED 2023-09-28 09:02:34,144 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695891740544.3b78e5c18844475dc961b228efcb1635.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695891754144"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695891754144"}]},"ts":"1695891754144"} 2023-09-28 09:02:34,147 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-09-28 09:02:34,147 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 3b78e5c18844475dc961b228efcb1635, server=jenkins-hbase4.apache.org,40311,1695891668959 in 168 msec 2023-09-28 09:02:34,148 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-09-28 09:02:34,148 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3b78e5c18844475dc961b228efcb1635, UNASSIGN in 174 msec 2023-09-28 09:02:34,149 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695891754149"}]},"ts":"1695891754149"} 2023-09-28 09:02:34,150 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-09-28 09:02:34,152 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-09-28 09:02:34,153 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 190 msec 2023-09-28 09:02:34,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-28 09:02:34,271 INFO [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-09-28 09:02:34,272 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:34,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:34,275 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:34,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:34,275 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:34,277 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40311] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:34,280 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d95b7d4096d2ffbbd3d8b01ffd468984 2023-09-28 09:02:34,280 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3b78e5c18844475dc961b228efcb1635 2023-09-28 09:02:34,280 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f51b7863fa47cb1fa8b77fa7d04d9e05 2023-09-28 09:02:34,280 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:34,280 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:34,280 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:34,281 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:34,281 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-28 09:02:34,281 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-28 09:02:34,282 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-28 09:02:34,282 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-28 09:02:34,282 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d95b7d4096d2ffbbd3d8b01ffd468984/cf, FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d95b7d4096d2ffbbd3d8b01ffd468984/recovered.edits] 2023-09-28 09:02:34,282 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3b78e5c18844475dc961b228efcb1635/cf, FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3b78e5c18844475dc961b228efcb1635/recovered.edits] 2023-09-28 09:02:34,282 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:34,282 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:34,282 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 09:02:34,282 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:34,283 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 09:02:34,283 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:34,283 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 09:02:34,282 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 09:02:34,282 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f51b7863fa47cb1fa8b77fa7d04d9e05/cf, FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f51b7863fa47cb1fa8b77fa7d04d9e05/recovered.edits] 2023-09-28 09:02:34,283 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-28 09:02:34,284 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-28 09:02:34,284 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-28 09:02:34,284 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-28 09:02:34,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-28 09:02:34,287 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d95b7d4096d2ffbbd3d8b01ffd468984/cf/2d6a3a3114664d8c95c019ace118257d to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d95b7d4096d2ffbbd3d8b01ffd468984/cf/2d6a3a3114664d8c95c019ace118257d 2023-09-28 09:02:34,287 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3b78e5c18844475dc961b228efcb1635/cf/2bf693c1d396448f84035bdc9a91aafd.f51b7863fa47cb1fa8b77fa7d04d9e05 to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3b78e5c18844475dc961b228efcb1635/cf/2bf693c1d396448f84035bdc9a91aafd.f51b7863fa47cb1fa8b77fa7d04d9e05 2023-09-28 09:02:34,288 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f51b7863fa47cb1fa8b77fa7d04d9e05/cf/2bf693c1d396448f84035bdc9a91aafd to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f51b7863fa47cb1fa8b77fa7d04d9e05/cf/2bf693c1d396448f84035bdc9a91aafd 2023-09-28 09:02:34,293 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3b78e5c18844475dc961b228efcb1635/cf/2d6a3a3114664d8c95c019ace118257d.d95b7d4096d2ffbbd3d8b01ffd468984 to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3b78e5c18844475dc961b228efcb1635/cf/2d6a3a3114664d8c95c019ace118257d.d95b7d4096d2ffbbd3d8b01ffd468984 2023-09-28 09:02:34,294 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d95b7d4096d2ffbbd3d8b01ffd468984/recovered.edits/8.seqid to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d95b7d4096d2ffbbd3d8b01ffd468984/recovered.edits/8.seqid 2023-09-28 09:02:34,295 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d95b7d4096d2ffbbd3d8b01ffd468984 2023-09-28 09:02:34,295 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f51b7863fa47cb1fa8b77fa7d04d9e05/recovered.edits/8.seqid to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f51b7863fa47cb1fa8b77fa7d04d9e05/recovered.edits/8.seqid 2023-09-28 09:02:34,296 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f51b7863fa47cb1fa8b77fa7d04d9e05 2023-09-28 09:02:34,297 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3b78e5c18844475dc961b228efcb1635/recovered.edits/12.seqid to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3b78e5c18844475dc961b228efcb1635/recovered.edits/12.seqid 2023-09-28 09:02:34,297 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3b78e5c18844475dc961b228efcb1635 2023-09-28 09:02:34,297 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-28 09:02:34,299 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:34,301 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-09-28 09:02:34,303 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-09-28 09:02:34,304 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:34,304 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-09-28 09:02:34,304 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695891740544.3b78e5c18844475dc961b228efcb1635.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695891754304"}]},"ts":"9223372036854775807"} 2023-09-28 09:02:34,305 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-09-28 09:02:34,305 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3b78e5c18844475dc961b228efcb1635, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695891740544.3b78e5c18844475dc961b228efcb1635.', STARTKEY => '', ENDKEY => ''}] 2023-09-28 09:02:34,305 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-09-28 09:02:34,306 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695891754305"}]},"ts":"9223372036854775807"} 2023-09-28 09:02:34,307 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-09-28 09:02:34,309 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:34,310 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 37 msec 2023-09-28 09:02:34,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-28 09:02:34,385 INFO [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-09-28 09:02:34,386 INFO [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:34,386 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:34,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:34,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-28 09:02:34,391 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695891754390"}]},"ts":"1695891754390"} 2023-09-28 09:02:34,392 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-09-28 09:02:34,393 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-09-28 09:02:34,394 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=73ef00c40f86e6757c56d65afe439aba, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6f80ccbc58e4ace77590e2ce4207efe8, UNASSIGN}] 2023-09-28 09:02:34,396 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=73ef00c40f86e6757c56d65afe439aba, UNASSIGN 2023-09-28 09:02:34,396 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6f80ccbc58e4ace77590e2ce4207efe8, UNASSIGN 2023-09-28 09:02:34,397 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=73ef00c40f86e6757c56d65afe439aba, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:34,397 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=6f80ccbc58e4ace77590e2ce4207efe8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:34,397 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695891739392.73ef00c40f86e6757c56d65afe439aba.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695891754397"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695891754397"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695891754397"}]},"ts":"1695891754397"} 2023-09-28 09:02:34,397 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695891739392.6f80ccbc58e4ace77590e2ce4207efe8.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695891754397"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695891754397"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695891754397"}]},"ts":"1695891754397"} 2023-09-28 09:02:34,398 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 73ef00c40f86e6757c56d65afe439aba, server=jenkins-hbase4.apache.org,40311,1695891668959}] 2023-09-28 09:02:34,399 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 6f80ccbc58e4ace77590e2ce4207efe8, server=jenkins-hbase4.apache.org,40045,1695891669000}] 2023-09-28 09:02:34,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-28 09:02:34,550 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6f80ccbc58e4ace77590e2ce4207efe8 2023-09-28 09:02:34,550 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 73ef00c40f86e6757c56d65afe439aba 2023-09-28 09:02:34,550 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6f80ccbc58e4ace77590e2ce4207efe8, disabling compactions & flushes 2023-09-28 09:02:34,550 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 73ef00c40f86e6757c56d65afe439aba, disabling compactions & flushes 2023-09-28 09:02:34,550 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695891739392.6f80ccbc58e4ace77590e2ce4207efe8. 2023-09-28 09:02:34,550 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695891739392.73ef00c40f86e6757c56d65afe439aba. 2023-09-28 09:02:34,550 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695891739392.6f80ccbc58e4ace77590e2ce4207efe8. 2023-09-28 09:02:34,550 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695891739392.73ef00c40f86e6757c56d65afe439aba. 2023-09-28 09:02:34,550 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695891739392.6f80ccbc58e4ace77590e2ce4207efe8. after waiting 0 ms 2023-09-28 09:02:34,551 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695891739392.6f80ccbc58e4ace77590e2ce4207efe8. 2023-09-28 09:02:34,550 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695891739392.73ef00c40f86e6757c56d65afe439aba. after waiting 0 ms 2023-09-28 09:02:34,551 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695891739392.73ef00c40f86e6757c56d65afe439aba. 2023-09-28 09:02:34,560 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion/73ef00c40f86e6757c56d65afe439aba/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-28 09:02:34,560 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f80ccbc58e4ace77590e2ce4207efe8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-28 09:02:34,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 09:02:34,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 09:02:34,561 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695891739392.73ef00c40f86e6757c56d65afe439aba. 2023-09-28 09:02:34,562 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695891739392.6f80ccbc58e4ace77590e2ce4207efe8. 2023-09-28 09:02:34,562 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6f80ccbc58e4ace77590e2ce4207efe8: 2023-09-28 09:02:34,562 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 73ef00c40f86e6757c56d65afe439aba: 2023-09-28 09:02:34,564 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6f80ccbc58e4ace77590e2ce4207efe8 2023-09-28 09:02:34,564 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=6f80ccbc58e4ace77590e2ce4207efe8, regionState=CLOSED 2023-09-28 09:02:34,564 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695891739392.6f80ccbc58e4ace77590e2ce4207efe8.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695891754564"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695891754564"}]},"ts":"1695891754564"} 2023-09-28 09:02:34,565 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 73ef00c40f86e6757c56d65afe439aba 2023-09-28 09:02:34,565 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=73ef00c40f86e6757c56d65afe439aba, regionState=CLOSED 2023-09-28 09:02:34,565 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695891739392.73ef00c40f86e6757c56d65afe439aba.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695891754565"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695891754565"}]},"ts":"1695891754565"} 2023-09-28 09:02:34,567 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=86 2023-09-28 09:02:34,568 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 6f80ccbc58e4ace77590e2ce4207efe8, server=jenkins-hbase4.apache.org,40045,1695891669000 in 167 msec 2023-09-28 09:02:34,569 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=85 2023-09-28 09:02:34,569 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6f80ccbc58e4ace77590e2ce4207efe8, UNASSIGN in 174 msec 2023-09-28 09:02:34,569 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 73ef00c40f86e6757c56d65afe439aba, server=jenkins-hbase4.apache.org,40311,1695891668959 in 169 msec 2023-09-28 09:02:34,570 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=85, resume processing ppid=84 2023-09-28 09:02:34,570 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=73ef00c40f86e6757c56d65afe439aba, UNASSIGN in 175 msec 2023-09-28 09:02:34,571 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695891754570"}]},"ts":"1695891754570"} 2023-09-28 09:02:34,572 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-09-28 09:02:34,574 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-09-28 09:02:34,576 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 189 msec 2023-09-28 09:02:34,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-28 09:02:34,693 INFO [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-09-28 09:02:34,693 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:34,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:34,696 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:34,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:34,697 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:34,698 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40311] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:34,701 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:34,701 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:34,701 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:34,701 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:34,701 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/73ef00c40f86e6757c56d65afe439aba 2023-09-28 09:02:34,701 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-28 09:02:34,701 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-28 09:02:34,701 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f80ccbc58e4ace77590e2ce4207efe8 2023-09-28 09:02:34,701 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-28 09:02:34,701 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-28 09:02:34,702 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:34,702 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:34,702 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:34,702 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 09:02:34,702 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 09:02:34,702 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:34,702 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 09:02:34,702 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 09:02:34,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-28 09:02:34,703 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/73ef00c40f86e6757c56d65afe439aba/cf, FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/73ef00c40f86e6757c56d65afe439aba/recovered.edits] 2023-09-28 09:02:34,704 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f80ccbc58e4ace77590e2ce4207efe8/cf, FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f80ccbc58e4ace77590e2ce4207efe8/recovered.edits] 2023-09-28 09:02:34,707 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/73ef00c40f86e6757c56d65afe439aba/cf/2fadcb180fcf4deb8fe8ae2e9e524e5a to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/73ef00c40f86e6757c56d65afe439aba/cf/2fadcb180fcf4deb8fe8ae2e9e524e5a 2023-09-28 09:02:34,707 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f80ccbc58e4ace77590e2ce4207efe8/cf/60deed8b5a94456dbcede90b15fa93bc to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f80ccbc58e4ace77590e2ce4207efe8/cf/60deed8b5a94456dbcede90b15fa93bc 2023-09-28 09:02:34,710 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/73ef00c40f86e6757c56d65afe439aba/recovered.edits/9.seqid to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/73ef00c40f86e6757c56d65afe439aba/recovered.edits/9.seqid 2023-09-28 09:02:34,710 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f80ccbc58e4ace77590e2ce4207efe8/recovered.edits/9.seqid to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f80ccbc58e4ace77590e2ce4207efe8/recovered.edits/9.seqid 2023-09-28 09:02:34,711 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f80ccbc58e4ace77590e2ce4207efe8 2023-09-28 09:02:34,711 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/73ef00c40f86e6757c56d65afe439aba 2023-09-28 09:02:34,711 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-28 09:02:34,711 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-28 09:02:34,712 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-09-28 09:02:34,715 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023092818dea5b2c0f44e438698152392fd4a98 to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023092818dea5b2c0f44e438698152392fd4a98 2023-09-28 09:02:34,716 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230928ae7d40d3b62347dc9a0ddb30bcbb4fbd to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230928ae7d40d3b62347dc9a0ddb30bcbb4fbd 2023-09-28 09:02:34,717 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-28 09:02:34,719 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:34,720 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-09-28 09:02:34,722 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-09-28 09:02:34,723 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:34,723 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-09-28 09:02:34,723 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695891739392.73ef00c40f86e6757c56d65afe439aba.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695891754723"}]},"ts":"9223372036854775807"} 2023-09-28 09:02:34,723 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695891739392.6f80ccbc58e4ace77590e2ce4207efe8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695891754723"}]},"ts":"9223372036854775807"} 2023-09-28 09:02:34,725 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-28 09:02:34,725 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 73ef00c40f86e6757c56d65afe439aba, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695891739392.73ef00c40f86e6757c56d65afe439aba.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 6f80ccbc58e4ace77590e2ce4207efe8, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695891739392.6f80ccbc58e4ace77590e2ce4207efe8.', STARTKEY => '1', ENDKEY => ''}] 2023-09-28 09:02:34,725 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-09-28 09:02:34,725 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695891754725"}]},"ts":"9223372036854775807"} 2023-09-28 09:02:34,726 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-09-28 09:02:34,729 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:34,730 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 36 msec 2023-09-28 09:02:34,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-28 09:02:34,805 INFO [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-09-28 09:02:34,814 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-28 09:02:34,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:34,818 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-28 09:02:34,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 09:02:34,820 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-09-28 09:02:34,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 09:02:34,845 INFO [Listener at jenkins-hbase4.apache.org/39071] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=759 (was 749) Potentially hanging thread: Thread-3954 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3ff53656-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1698010877_17 at /127.0.0.1:57336 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3ff53656-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3ff53656-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3ff53656-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1630284099_1 at /127.0.0.1:51552 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3ff53656-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (32912118) connection to jenkins-hbase4.apache.org/172.31.14.131:40335 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1698010877_17 at /127.0.0.1:58046 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3ff53656-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1698010877_17 at /127.0.0.1:51588 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=909 (was 900) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=246 (was 259), ProcessCount=168 (was 168), AvailableMemoryMB=4808 (was 4729) - AvailableMemoryMB LEAK? - 2023-09-28 09:02:34,846 WARN [Listener at jenkins-hbase4.apache.org/39071] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-09-28 09:02:34,865 INFO [Listener at jenkins-hbase4.apache.org/39071] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=759, OpenFileDescriptor=909, MaxFileDescriptor=60000, SystemLoadAverage=246, ProcessCount=168, AvailableMemoryMB=4807 2023-09-28 09:02:34,865 WARN [Listener at jenkins-hbase4.apache.org/39071] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-09-28 09:02:34,867 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-28 09:02:34,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-28 09:02:34,870 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-28 09:02:34,870 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-09-28 09:02:34,871 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-28 09:02:34,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-28 09:02:34,873 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testEmptyExportFileSystemState/f340c537750709e86127da01dede129e 2023-09-28 09:02:34,873 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testEmptyExportFileSystemState/b8236103834b88019e4dd6bb024b8adb 2023-09-28 09:02:34,874 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testEmptyExportFileSystemState/f340c537750709e86127da01dede129e empty. 2023-09-28 09:02:34,874 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testEmptyExportFileSystemState/b8236103834b88019e4dd6bb024b8adb empty. 2023-09-28 09:02:34,874 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testEmptyExportFileSystemState/f340c537750709e86127da01dede129e 2023-09-28 09:02:34,874 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testEmptyExportFileSystemState/b8236103834b88019e4dd6bb024b8adb 2023-09-28 09:02:34,874 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-28 09:02:34,883 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-28 09:02:34,884 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => b8236103834b88019e4dd6bb024b8adb, NAME => 'testtb-testEmptyExportFileSystemState,1,1695891754867.b8236103834b88019e4dd6bb024b8adb.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp 2023-09-28 09:02:34,884 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => f340c537750709e86127da01dede129e, NAME => 'testtb-testEmptyExportFileSystemState,,1695891754867.f340c537750709e86127da01dede129e.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp 2023-09-28 09:02:34,897 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695891754867.f340c537750709e86127da01dede129e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 09:02:34,898 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing f340c537750709e86127da01dede129e, disabling compactions & flushes 2023-09-28 09:02:34,898 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695891754867.f340c537750709e86127da01dede129e. 2023-09-28 09:02:34,898 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695891754867.f340c537750709e86127da01dede129e. 2023-09-28 09:02:34,898 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695891754867.f340c537750709e86127da01dede129e. after waiting 0 ms 2023-09-28 09:02:34,898 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695891754867.f340c537750709e86127da01dede129e. 2023-09-28 09:02:34,898 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695891754867.f340c537750709e86127da01dede129e. 2023-09-28 09:02:34,898 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for f340c537750709e86127da01dede129e: 2023-09-28 09:02:34,899 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695891754867.b8236103834b88019e4dd6bb024b8adb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 09:02:34,899 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing b8236103834b88019e4dd6bb024b8adb, disabling compactions & flushes 2023-09-28 09:02:34,899 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695891754867.b8236103834b88019e4dd6bb024b8adb. 2023-09-28 09:02:34,899 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695891754867.b8236103834b88019e4dd6bb024b8adb. 2023-09-28 09:02:34,899 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695891754867.b8236103834b88019e4dd6bb024b8adb. after waiting 0 ms 2023-09-28 09:02:34,899 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695891754867.b8236103834b88019e4dd6bb024b8adb. 2023-09-28 09:02:34,899 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695891754867.b8236103834b88019e4dd6bb024b8adb. 2023-09-28 09:02:34,899 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for b8236103834b88019e4dd6bb024b8adb: 2023-09-28 09:02:34,901 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-28 09:02:34,902 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695891754867.f340c537750709e86127da01dede129e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695891754902"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695891754902"}]},"ts":"1695891754902"} 2023-09-28 09:02:34,902 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695891754867.b8236103834b88019e4dd6bb024b8adb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695891754902"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695891754902"}]},"ts":"1695891754902"} 2023-09-28 09:02:34,904 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-28 09:02:34,905 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-28 09:02:34,905 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695891754905"}]},"ts":"1695891754905"} 2023-09-28 09:02:34,907 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-09-28 09:02:34,911 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-28 09:02:34,912 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-28 09:02:34,912 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-28 09:02:34,912 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-28 09:02:34,912 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-28 09:02:34,912 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f340c537750709e86127da01dede129e, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b8236103834b88019e4dd6bb024b8adb, ASSIGN}] 2023-09-28 09:02:34,914 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b8236103834b88019e4dd6bb024b8adb, ASSIGN 2023-09-28 09:02:34,914 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f340c537750709e86127da01dede129e, ASSIGN 2023-09-28 09:02:34,915 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f340c537750709e86127da01dede129e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39195,1695891668910; forceNewPlan=false, retain=false 2023-09-28 09:02:34,915 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b8236103834b88019e4dd6bb024b8adb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40045,1695891669000; forceNewPlan=false, retain=false 2023-09-28 09:02:34,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-28 09:02:35,065 INFO [jenkins-hbase4:40293] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-28 09:02:35,068 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=f340c537750709e86127da01dede129e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:35,068 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=b8236103834b88019e4dd6bb024b8adb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:35,068 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695891754867.f340c537750709e86127da01dede129e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695891755068"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695891755068"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695891755068"}]},"ts":"1695891755068"} 2023-09-28 09:02:35,068 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695891754867.b8236103834b88019e4dd6bb024b8adb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695891755068"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695891755068"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695891755068"}]},"ts":"1695891755068"} 2023-09-28 09:02:35,070 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure f340c537750709e86127da01dede129e, server=jenkins-hbase4.apache.org,39195,1695891668910}] 2023-09-28 09:02:35,071 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure b8236103834b88019e4dd6bb024b8adb, server=jenkins-hbase4.apache.org,40045,1695891669000}] 2023-09-28 09:02:35,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-28 09:02:35,228 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1695891754867.f340c537750709e86127da01dede129e. 2023-09-28 09:02:35,228 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1695891754867.b8236103834b88019e4dd6bb024b8adb. 2023-09-28 09:02:35,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f340c537750709e86127da01dede129e, NAME => 'testtb-testEmptyExportFileSystemState,,1695891754867.f340c537750709e86127da01dede129e.', STARTKEY => '', ENDKEY => '1'} 2023-09-28 09:02:35,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b8236103834b88019e4dd6bb024b8adb, NAME => 'testtb-testEmptyExportFileSystemState,1,1695891754867.b8236103834b88019e4dd6bb024b8adb.', STARTKEY => '1', ENDKEY => ''} 2023-09-28 09:02:35,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1695891754867.f340c537750709e86127da01dede129e. service=AccessControlService 2023-09-28 09:02:35,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1695891754867.b8236103834b88019e4dd6bb024b8adb. service=AccessControlService 2023-09-28 09:02:35,228 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 09:02:35,228 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 09:02:35,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState f340c537750709e86127da01dede129e 2023-09-28 09:02:35,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState b8236103834b88019e4dd6bb024b8adb 2023-09-28 09:02:35,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695891754867.f340c537750709e86127da01dede129e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 09:02:35,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695891754867.b8236103834b88019e4dd6bb024b8adb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 09:02:35,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f340c537750709e86127da01dede129e 2023-09-28 09:02:35,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f340c537750709e86127da01dede129e 2023-09-28 09:02:35,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b8236103834b88019e4dd6bb024b8adb 2023-09-28 09:02:35,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b8236103834b88019e4dd6bb024b8adb 2023-09-28 09:02:35,230 INFO [StoreOpener-b8236103834b88019e4dd6bb024b8adb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b8236103834b88019e4dd6bb024b8adb 2023-09-28 09:02:35,230 INFO [StoreOpener-f340c537750709e86127da01dede129e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f340c537750709e86127da01dede129e 2023-09-28 09:02:35,231 DEBUG [StoreOpener-b8236103834b88019e4dd6bb024b8adb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testEmptyExportFileSystemState/b8236103834b88019e4dd6bb024b8adb/cf 2023-09-28 09:02:35,231 DEBUG [StoreOpener-b8236103834b88019e4dd6bb024b8adb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testEmptyExportFileSystemState/b8236103834b88019e4dd6bb024b8adb/cf 2023-09-28 09:02:35,231 DEBUG [StoreOpener-f340c537750709e86127da01dede129e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testEmptyExportFileSystemState/f340c537750709e86127da01dede129e/cf 2023-09-28 09:02:35,231 DEBUG [StoreOpener-f340c537750709e86127da01dede129e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testEmptyExportFileSystemState/f340c537750709e86127da01dede129e/cf 2023-09-28 09:02:35,232 INFO [StoreOpener-f340c537750709e86127da01dede129e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f340c537750709e86127da01dede129e columnFamilyName cf 2023-09-28 09:02:35,232 INFO [StoreOpener-b8236103834b88019e4dd6bb024b8adb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b8236103834b88019e4dd6bb024b8adb columnFamilyName cf 2023-09-28 09:02:35,233 INFO [StoreOpener-f340c537750709e86127da01dede129e-1] regionserver.HStore(310): Store=f340c537750709e86127da01dede129e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 09:02:35,233 INFO [StoreOpener-b8236103834b88019e4dd6bb024b8adb-1] regionserver.HStore(310): Store=b8236103834b88019e4dd6bb024b8adb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 09:02:35,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testEmptyExportFileSystemState/b8236103834b88019e4dd6bb024b8adb 2023-09-28 09:02:35,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testEmptyExportFileSystemState/f340c537750709e86127da01dede129e 2023-09-28 09:02:35,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testEmptyExportFileSystemState/b8236103834b88019e4dd6bb024b8adb 2023-09-28 09:02:35,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testEmptyExportFileSystemState/f340c537750709e86127da01dede129e 2023-09-28 09:02:35,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b8236103834b88019e4dd6bb024b8adb 2023-09-28 09:02:35,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f340c537750709e86127da01dede129e 2023-09-28 09:02:35,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testEmptyExportFileSystemState/b8236103834b88019e4dd6bb024b8adb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 09:02:35,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testEmptyExportFileSystemState/f340c537750709e86127da01dede129e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 09:02:35,239 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b8236103834b88019e4dd6bb024b8adb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59017227, jitterRate=-0.12057478725910187}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 09:02:35,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b8236103834b88019e4dd6bb024b8adb: 2023-09-28 09:02:35,240 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f340c537750709e86127da01dede129e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67016651, jitterRate=-0.001374080777168274}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 09:02:35,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f340c537750709e86127da01dede129e: 2023-09-28 09:02:35,240 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1695891754867.b8236103834b88019e4dd6bb024b8adb., pid=94, masterSystemTime=1695891755223 2023-09-28 09:02:35,240 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1695891754867.f340c537750709e86127da01dede129e., pid=93, masterSystemTime=1695891755221 2023-09-28 09:02:35,241 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1695891754867.b8236103834b88019e4dd6bb024b8adb. 2023-09-28 09:02:35,242 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1695891754867.b8236103834b88019e4dd6bb024b8adb. 2023-09-28 09:02:35,242 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=b8236103834b88019e4dd6bb024b8adb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:35,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1695891754867.f340c537750709e86127da01dede129e. 2023-09-28 09:02:35,242 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1695891754867.f340c537750709e86127da01dede129e. 2023-09-28 09:02:35,242 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1695891754867.b8236103834b88019e4dd6bb024b8adb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695891755242"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695891755242"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695891755242"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695891755242"}]},"ts":"1695891755242"} 2023-09-28 09:02:35,243 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=f340c537750709e86127da01dede129e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:35,243 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1695891754867.f340c537750709e86127da01dede129e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695891755242"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695891755242"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695891755242"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695891755242"}]},"ts":"1695891755242"} 2023-09-28 09:02:35,245 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=92 2023-09-28 09:02:35,245 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure b8236103834b88019e4dd6bb024b8adb, server=jenkins-hbase4.apache.org,40045,1695891669000 in 173 msec 2023-09-28 09:02:35,246 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=91 2023-09-28 09:02:35,246 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure f340c537750709e86127da01dede129e, server=jenkins-hbase4.apache.org,39195,1695891668910 in 175 msec 2023-09-28 09:02:35,246 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b8236103834b88019e4dd6bb024b8adb, ASSIGN in 333 msec 2023-09-28 09:02:35,248 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=91, resume processing ppid=90 2023-09-28 09:02:35,248 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f340c537750709e86127da01dede129e, ASSIGN in 334 msec 2023-09-28 09:02:35,248 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-28 09:02:35,248 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695891755248"}]},"ts":"1695891755248"} 2023-09-28 09:02:35,249 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-09-28 09:02:35,251 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-28 09:02:35,252 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-09-28 09:02:35,253 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40311] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-28 09:02:35,255 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 09:02:35,255 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 09:02:35,255 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 09:02:35,255 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 09:02:35,257 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-28 09:02:35,257 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-28 09:02:35,257 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-28 09:02:35,257 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-28 09:02:35,258 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 389 msec 2023-09-28 09:02:35,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-28 09:02:35,474 INFO [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-09-28 09:02:35,476 DEBUG [Listener at jenkins-hbase4.apache.org/39071] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-28 09:02:35,476 DEBUG [Listener at jenkins-hbase4.apache.org/39071] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695891754867.f340c537750709e86127da01dede129e. 2023-09-28 09:02:35,478 INFO [Listener at jenkins-hbase4.apache.org/39071] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-28 09:02:35,488 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-28 09:02:35,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695891755488 (current time:1695891755488). 2023-09-28 09:02:35,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-28 09:02:35,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] zookeeper.ReadOnlyZKClient(139): Connect 0x5d1d537d to 127.0.0.1:61959 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 09:02:35,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a649640, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 09:02:35,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 09:02:35,503 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44282, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 09:02:35,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5d1d537d to 127.0.0.1:61959 2023-09-28 09:02:35,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 09:02:35,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] zookeeper.ReadOnlyZKClient(139): Connect 0x122ef755 to 127.0.0.1:61959 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 09:02:35,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@259fd8d6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 09:02:35,512 DEBUG [hconnection-0x6b078cb3-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 09:02:35,513 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44292, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 09:02:35,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x122ef755 to 127.0.0.1:61959 2023-09-28 09:02:35,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 09:02:35,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-28 09:02:35,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-28 09:02:35,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-28 09:02:35,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-28 09:02:35,521 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-28 09:02:35,522 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695892355522 2023-09-28 09:02:35,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-28 09:02:35,522 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-28 09:02:35,523 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-28 09:02:35,523 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-28 09:02:35,524 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-28 09:02:35,524 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-28 09:02:35,525 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 4 msec 2023-09-28 09:02:35,528 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-28 09:02:35,529 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695892355529 2023-09-28 09:02:35,539 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,539 INFO [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-09-28 09:02:35,539 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 09:02:35,541 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-28 09:02:35,541 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-28 09:02:35,541 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,541 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,547 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:02:35,547 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:02:35,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:02:35,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:02:35,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:02:35,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:02:35,547 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:02:35,547 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:35,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:02:35,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:02:35,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,548 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:35,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,548 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:35,548 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,548 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,548 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:35,548 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-28 09:02:35,548 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-28 09:02:35,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-28 09:02:35,548 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-28 09:02:35,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-28 09:02:35,549 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,549 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-28 09:02:35,549 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-28 09:02:35,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,549 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 09:02:35,549 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-28 09:02:35,549 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,550 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-28 09:02:35,550 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-28 09:02:35,550 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,550 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-28 09:02:35,550 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-28 09:02:35,550 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 09:02:35,550 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 09:02:35,551 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-28 09:02:35,552 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-28 09:02:35,552 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40311,1695891668959' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-28 09:02:35,550 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39195,1695891668910' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-28 09:02:35,552 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-28 09:02:35,552 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-28 09:02:35,552 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40045,1695891669000' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-28 09:02:35,555 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,556 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:35,556 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:35,556 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,556 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:35,556 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,556 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 09:02:35,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:02:35,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:02:35,556 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,556 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 09:02:35,556 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,556 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 09:02:35,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:02:35,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:02:35,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:35,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:35,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:35,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:02:35,559 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39195,1695891668910' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-28 09:02:35,559 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a64c014[Count = 1] remaining members to acquire global barrier 2023-09-28 09:02:35,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:35,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:02:35,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:02:35,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:02:35,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:02:35,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:35,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:35,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:35,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:02:35,561 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40045,1695891669000' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-28 09:02:35,561 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a64c014[Count = 0] remaining members to acquire global barrier 2023-09-28 09:02:35,561 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-28 09:02:35,561 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,562 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,562 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,562 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,563 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-28 09:02:35,563 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:35,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,563 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-28 09:02:35,563 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-28 09:02:35,563 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 09:02:35,563 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 09:02:35,563 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-28 09:02:35,563 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695891754867.b8236103834b88019e4dd6bb024b8adb. 2023-09-28 09:02:35,563 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:35,563 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-28 09:02:35,563 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695891754867.f340c537750709e86127da01dede129e. 2023-09-28 09:02:35,563 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695891754867.b8236103834b88019e4dd6bb024b8adb. started... 2023-09-28 09:02:35,563 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695891754867.f340c537750709e86127da01dede129e. started... 2023-09-28 09:02:35,563 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40311,1695891668959' in zk 2023-09-28 09:02:35,563 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 09:02:35,565 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 09:02:35,565 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b8236103834b88019e4dd6bb024b8adb: 2023-09-28 09:02:35,565 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f340c537750709e86127da01dede129e: 2023-09-28 09:02:35,565 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695891754867.b8236103834b88019e4dd6bb024b8adb.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,565 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695891754867.f340c537750709e86127da01dede129e.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,565 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 09:02:35,565 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 09:02:35,565 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-28 09:02:35,565 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-28 09:02:35,566 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-28 09:02:35,566 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 09:02:35,566 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-28 09:02:35,574 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695891754867.b8236103834b88019e4dd6bb024b8adb. completed. 2023-09-28 09:02:35,574 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695891754867.b8236103834b88019e4dd6bb024b8adb. 2023-09-28 09:02:35,574 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 09:02:35,574 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 09:02:35,574 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:35,574 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-28 09:02:35,574 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40045,1695891669000' in zk 2023-09-28 09:02:35,574 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695891754867.f340c537750709e86127da01dede129e. completed. 2023-09-28 09:02:35,574 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695891754867.f340c537750709e86127da01dede129e. 2023-09-28 09:02:35,574 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 09:02:35,574 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 09:02:35,574 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:35,574 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-28 09:02:35,575 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39195,1695891668910' in zk 2023-09-28 09:02:35,576 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-28 09:02:35,576 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:35,576 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 09:02:35,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:35,576 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-28 09:02:35,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:02:35,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:02:35,579 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:35,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:02:35,579 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-28 09:02:35,579 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 09:02:35,579 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-28 09:02:35,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:02:35,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:35,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:35,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:35,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:02:35,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:35,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:35,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:35,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40045,1695891669000': 2023-09-28 09:02:35,583 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40045,1695891669000' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-28 09:02:35,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:35,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:02:35,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:02:35,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:02:35,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:02:35,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:35,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:35,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:35,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:02:35,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:35,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:35,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:35,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39195,1695891668910': 2023-09-28 09:02:35,586 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39195,1695891668910' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-28 09:02:35,586 INFO [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-09-28 09:02:35,586 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-28 09:02:35,586 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-28 09:02:35,586 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,586 INFO [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-28 09:02:35,587 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,587 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,587 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,587 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:02:35,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,587 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,587 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:02:35,588 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:02:35,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:02:35,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:02:35,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:02:35,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:02:35,588 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:35,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:02:35,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:02:35,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:02:35,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:02:35,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:02:35,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,588 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:35,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,589 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:35,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:02:35,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:35,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:35,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:35,591 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:35,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:02:35,591 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:35,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,591 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:35,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:35,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:35,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:35,594 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:35,594 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,594 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:35,594 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:02:35,594 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:35,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:02:35,594 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:02:35,594 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:02:35,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:02:35,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:02:35,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:02:35,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:02:35,594 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:02:35,594 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:02:35,594 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 09:02:35,594 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:02:35,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:02:35,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:02:35,594 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,594 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:02:35,596 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:35,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:02:35,596 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-28 09:02:35,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:02:35,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:02:35,596 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:02:35,596 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,596 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-28 09:02:35,597 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:35,597 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:35,597 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,597 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,597 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-28 09:02:35,604 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,604 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,620 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,620 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-28 09:02:35,620 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,621 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,621 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695891755522Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695891755604 (+82 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695891755604Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1695891755604Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1695891755608 (+4 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695891755615 (+7 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695891755620 (+5 ms) 2023-09-28 09:02:35,624 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-28 09:02:35,624 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 09:02:35,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-28 09:02:35,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-28 09:02:35,626 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 101 msec 2023-09-28 09:02:35,627 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39195] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1695891754867.f340c537750709e86127da01dede129e. with WAL disabled. Data may be lost in the event of a crash. 2023-09-28 09:02:35,628 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40045] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1695891754867.b8236103834b88019e4dd6bb024b8adb. with WAL disabled. Data may be lost in the event of a crash. 2023-09-28 09:02:35,630 DEBUG [Listener at jenkins-hbase4.apache.org/39071] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-28 09:02:35,630 DEBUG [Listener at jenkins-hbase4.apache.org/39071] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695891754867.f340c537750709e86127da01dede129e. 2023-09-28 09:02:35,630 INFO [Listener at jenkins-hbase4.apache.org/39071] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-28 09:02:35,639 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-28 09:02:35,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695891755639 (current time:1695891755639). 2023-09-28 09:02:35,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-28 09:02:35,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] zookeeper.ReadOnlyZKClient(139): Connect 0x25bc075b to 127.0.0.1:61959 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 09:02:35,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7209754b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 09:02:35,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 09:02:35,649 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44296, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 09:02:35,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x25bc075b to 127.0.0.1:61959 2023-09-28 09:02:35,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 09:02:35,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] zookeeper.ReadOnlyZKClient(139): Connect 0x19d09bfc to 127.0.0.1:61959 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 09:02:35,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5c93d142, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 09:02:35,657 DEBUG [hconnection-0x658954b6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 09:02:35,659 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44306, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 09:02:35,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x19d09bfc to 127.0.0.1:61959 2023-09-28 09:02:35,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 09:02:35,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-28 09:02:35,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-28 09:02:35,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-28 09:02:35,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-28 09:02:35,667 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-28 09:02:35,667 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695892355667 2023-09-28 09:02:35,667 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-28 09:02:35,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-28 09:02:35,669 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-28 09:02:35,669 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-28 09:02:35,669 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-28 09:02:35,670 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-28 09:02:35,671 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-09-28 09:02:35,671 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-28 09:02:35,672 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695892355672 2023-09-28 09:02:35,680 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,680 INFO [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-09-28 09:02:35,680 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 09:02:35,681 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-28 09:02:35,681 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-28 09:02:35,682 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,682 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,684 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:02:35,684 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:02:35,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:02:35,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:02:35,684 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:02:35,684 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:35,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:02:35,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:02:35,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:02:35,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:02:35,685 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:35,685 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:35,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,685 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:35,685 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,685 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-28 09:02:35,685 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,685 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-28 09:02:35,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-28 09:02:35,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-28 09:02:35,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,686 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-28 09:02:35,686 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-28 09:02:35,686 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-28 09:02:35,686 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,686 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-28 09:02:35,686 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,686 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 09:02:35,686 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-28 09:02:35,686 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,690 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-28 09:02:35,690 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-28 09:02:35,686 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 09:02:35,690 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 09:02:35,691 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-28 09:02:35,691 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-28 09:02:35,694 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40045,1695891669000' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-28 09:02:35,690 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-28 09:02:35,694 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-28 09:02:35,694 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-28 09:02:35,694 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39195,1695891668910' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-28 09:02:35,694 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40311,1695891668959' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-28 09:02:35,695 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:35,695 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:35,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:02:35,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:02:35,696 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:35,696 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,696 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 09:02:35,696 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,696 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:02:35,696 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,696 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 09:02:35,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:02:35,696 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,697 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 09:02:35,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:35,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:35,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:35,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:02:35,698 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40045,1695891669000' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-28 09:02:35,698 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2232e8f6[Count = 1] remaining members to acquire global barrier 2023-09-28 09:02:35,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:35,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:02:35,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:02:35,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:02:35,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:02:35,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:35,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:35,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:35,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:02:35,700 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39195,1695891668910' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-28 09:02:35,700 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2232e8f6[Count = 0] remaining members to acquire global barrier 2023-09-28 09:02:35,700 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-28 09:02:35,700 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,704 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,704 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,704 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,705 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-28 09:02:35,705 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:35,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,705 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 09:02:35,705 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695891754867.f340c537750709e86127da01dede129e. 2023-09-28 09:02:35,705 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-28 09:02:35,705 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695891754867.f340c537750709e86127da01dede129e. started... 2023-09-28 09:02:35,705 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-28 09:02:35,705 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:35,705 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-28 09:02:35,705 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-28 09:02:35,705 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 09:02:35,705 INFO [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f340c537750709e86127da01dede129e 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-09-28 09:02:35,705 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40311,1695891668959' in zk 2023-09-28 09:02:35,705 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 09:02:35,705 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 09:02:35,705 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695891754867.b8236103834b88019e4dd6bb024b8adb. 2023-09-28 09:02:35,705 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695891754867.b8236103834b88019e4dd6bb024b8adb. started... 2023-09-28 09:02:35,706 INFO [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b8236103834b88019e4dd6bb024b8adb 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-09-28 09:02:35,707 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-28 09:02:35,707 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 09:02:35,707 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-28 09:02:35,724 INFO [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309287062f73297e64a29979425dc2b3fd0fd to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309287062f73297e64a29979425dc2b3fd0fd 2023-09-28 09:02:35,726 INFO [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230928eb5deca192844a7485186488d915fe64 to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230928eb5deca192844a7485186488d915fe64 2023-09-28 09:02:35,731 INFO [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testEmptyExportFileSystemState/f340c537750709e86127da01dede129e/.tmp/cf/f35899a5613d4382a89b8b5fd5415f65 2023-09-28 09:02:35,733 INFO [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testEmptyExportFileSystemState/b8236103834b88019e4dd6bb024b8adb/.tmp/cf/7a02192510b1423eaba7d93788917b05 2023-09-28 09:02:35,736 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testEmptyExportFileSystemState/f340c537750709e86127da01dede129e/.tmp/cf/f35899a5613d4382a89b8b5fd5415f65 as hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testEmptyExportFileSystemState/f340c537750709e86127da01dede129e/cf/f35899a5613d4382a89b8b5fd5415f65 2023-09-28 09:02:35,737 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testEmptyExportFileSystemState/b8236103834b88019e4dd6bb024b8adb/.tmp/cf/7a02192510b1423eaba7d93788917b05 as hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testEmptyExportFileSystemState/b8236103834b88019e4dd6bb024b8adb/cf/7a02192510b1423eaba7d93788917b05 2023-09-28 09:02:35,741 INFO [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testEmptyExportFileSystemState/f340c537750709e86127da01dede129e/cf/f35899a5613d4382a89b8b5fd5415f65, entries=6, sequenceid=6, filesize=5.9 K 2023-09-28 09:02:35,742 INFO [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for f340c537750709e86127da01dede129e in 37ms, sequenceid=6, compaction requested=false 2023-09-28 09:02:35,742 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-28 09:02:35,742 INFO [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testEmptyExportFileSystemState/b8236103834b88019e4dd6bb024b8adb/cf/7a02192510b1423eaba7d93788917b05, entries=44, sequenceid=6, filesize=12.6 K 2023-09-28 09:02:35,742 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f340c537750709e86127da01dede129e: 2023-09-28 09:02:35,742 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695891754867.f340c537750709e86127da01dede129e.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,744 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 09:02:35,744 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testEmptyExportFileSystemState/f340c537750709e86127da01dede129e/cf/f35899a5613d4382a89b8b5fd5415f65] hfiles 2023-09-28 09:02:35,744 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testEmptyExportFileSystemState/f340c537750709e86127da01dede129e/cf/f35899a5613d4382a89b8b5fd5415f65 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,744 INFO [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for b8236103834b88019e4dd6bb024b8adb in 38ms, sequenceid=6, compaction requested=false 2023-09-28 09:02:35,746 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b8236103834b88019e4dd6bb024b8adb: 2023-09-28 09:02:35,746 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695891754867.b8236103834b88019e4dd6bb024b8adb.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,746 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 09:02:35,746 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testEmptyExportFileSystemState/b8236103834b88019e4dd6bb024b8adb/cf/7a02192510b1423eaba7d93788917b05] hfiles 2023-09-28 09:02:35,746 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testEmptyExportFileSystemState/b8236103834b88019e4dd6bb024b8adb/cf/7a02192510b1423eaba7d93788917b05 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,756 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695891754867.f340c537750709e86127da01dede129e. completed. 2023-09-28 09:02:35,756 DEBUG [rs(jenkins-hbase4.apache.org,39195,1695891668910)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695891754867.f340c537750709e86127da01dede129e. 2023-09-28 09:02:35,756 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 09:02:35,756 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 09:02:35,756 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:35,756 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-28 09:02:35,756 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39195,1695891668910' in zk 2023-09-28 09:02:35,757 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695891754867.b8236103834b88019e4dd6bb024b8adb. completed. 2023-09-28 09:02:35,757 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695891754867.b8236103834b88019e4dd6bb024b8adb. 2023-09-28 09:02:35,757 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 09:02:35,757 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 09:02:35,757 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:35,757 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-28 09:02:35,757 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40045,1695891669000' in zk 2023-09-28 09:02:35,758 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-28 09:02:35,758 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:35,758 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 09:02:35,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:35,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:02:35,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:02:35,758 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-28 09:02:35,761 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:35,761 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-28 09:02:35,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:02:35,761 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 09:02:35,761 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-28 09:02:35,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:02:35,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:35,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:35,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:35,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:02:35,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:35,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:35,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:35,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39195,1695891668910': 2023-09-28 09:02:35,766 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39195,1695891668910' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-28 09:02:35,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:35,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:02:35,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:02:35,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:02:35,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:02:35,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:35,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:35,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:35,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:02:35,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:35,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:35,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:35,769 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 09:02:35,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40045,1695891669000': 2023-09-28 09:02:35,769 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40045,1695891669000' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-28 09:02:35,769 INFO [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-09-28 09:02:35,770 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-28 09:02:35,770 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-28 09:02:35,770 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,770 INFO [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-28 09:02:35,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-28 09:02:35,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-28 09:02:35,770 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-28 09:02:35,771 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,771 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:02:35,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:02:35,771 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,771 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:02:35,771 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,771 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:02:35,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,772 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:02:35,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,772 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:35,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:02:35,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:02:35,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:02:35,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:02:35,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:02:35,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:02:35,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:02:35,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,772 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:35,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:02:35,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,773 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:35,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:35,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:35,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:35,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:02:35,774 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:35,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,775 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:35,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:35,775 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:35,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:35,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:35,778 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:02:35,778 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:02:35,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:02:35,778 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:02:35,778 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:35,778 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:02:35,778 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:02:35,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:02:35,778 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:02:35,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:02:35,778 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 09:02:35,778 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,778 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:35,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:02:35,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:02:35,778 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:02:35,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:02:35,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:02:35,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:02:35,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:02:35,779 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:35,778 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-28 09:02:35,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:02:35,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:02:35,780 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,780 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,780 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:35,780 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-28 09:02:35,780 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,780 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:35,780 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:35,780 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,780 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,781 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230928eb5deca192844a7485186488d915fe64, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309287062f73297e64a29979425dc2b3fd0fd] mob files 2023-09-28 09:02:35,781 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230928eb5deca192844a7485186488d915fe64 2023-09-28 09:02:35,781 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309287062f73297e64a29979425dc2b3fd0fd 2023-09-28 09:02:35,787 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,788 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,806 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,808 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-28 09:02:35,808 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,809 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,809 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695891755667Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695891755787 (+120 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1695891755787Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1695891755787Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1695891755793 (+6 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1695891755800 (+7 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695891755808 (+8 ms) 2023-09-28 09:02:35,811 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-28 09:02:35,812 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 143 msec 2023-09-28 09:02:35,970 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 09:02:35,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-28 09:02:35,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-28 09:02:35,972 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/export-test/export-1695891755972 2023-09-28 09:02:35,972 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:39781, tgtDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/export-test/export-1695891755972, rawTgtDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/export-test/export-1695891755972, srcFsUri=hdfs://localhost:39781, srcDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba 2023-09-28 09:02:35,995 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39781, inputRoot=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba 2023-09-28 09:02:35,995 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_774329749_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/export-test/export-1695891755972, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/export-test/export-1695891755972/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:35,995 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39781, inputRoot=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba, snapshotDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-09-28 09:02:36,000 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/export-test/export-1695891755972/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:36,042 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-28 09:02:36,042 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-28 09:02:36,043 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-28 09:02:36,043 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-28 09:02:36,914 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/hadoop-8473662467228992307.jar 2023-09-28 09:02:36,914 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-28 09:02:36,914 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-28 09:02:36,980 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/hadoop-2102280215392377709.jar 2023-09-28 09:02:36,981 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-28 09:02:36,981 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-28 09:02:36,981 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-28 09:02:36,982 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-28 09:02:36,982 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-28 09:02:36,982 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-28 09:02:36,983 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-28 09:02:36,983 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-28 09:02:36,983 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-28 09:02:36,984 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-28 09:02:36,984 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-28 09:02:36,984 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-28 09:02:36,985 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-28 09:02:36,985 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-28 09:02:36,985 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-28 09:02:36,986 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-28 09:02:36,986 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 09:02:36,987 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 09:02:36,987 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 09:02:36,987 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 09:02:36,988 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 09:02:36,988 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 09:02:36,989 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 09:02:37,340 WARN [Listener at jenkins-hbase4.apache.org/39071] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-28 09:02:37,342 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-09-28 09:02:39,066 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 09:02:39,066 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 09:02:39,068 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695891675416_0005_000001 (auth:SIMPLE) 2023-09-28 09:02:39,722 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-28 09:02:39,774 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695891675416_0006_000001 (auth:SIMPLE) 2023-09-28 09:02:43,621 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695891675416_0006_000001 (auth:SIMPLE) 2023-09-28 09:02:46,689 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-28 09:02:46,690 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-28 09:02:46,695 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:46,695 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-28 09:02:46,696 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-28 09:02:46,696 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1698010877_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:46,696 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(367): hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-28 09:02:46,696 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(367): hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-28 09:02:46,697 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1698010877_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/export-test/export-1695891755972/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/export-test/export-1695891755972/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:46,697 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(367): hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/export-test/export-1695891755972/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-28 09:02:46,697 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(367): hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/export-test/export-1695891755972/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-28 09:02:46,702 INFO [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-09-28 09:02:46,703 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-09-28 09:02:46,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-28 09:02:46,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-28 09:02:46,707 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695891766707"}]},"ts":"1695891766707"} 2023-09-28 09:02:46,709 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-09-28 09:02:46,710 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-09-28 09:02:46,711 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f340c537750709e86127da01dede129e, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b8236103834b88019e4dd6bb024b8adb, UNASSIGN}] 2023-09-28 09:02:46,716 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f340c537750709e86127da01dede129e, UNASSIGN 2023-09-28 09:02:46,716 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b8236103834b88019e4dd6bb024b8adb, UNASSIGN 2023-09-28 09:02:46,716 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=f340c537750709e86127da01dede129e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:46,716 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=b8236103834b88019e4dd6bb024b8adb, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:46,717 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695891754867.b8236103834b88019e4dd6bb024b8adb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695891766716"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695891766716"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695891766716"}]},"ts":"1695891766716"} 2023-09-28 09:02:46,717 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695891754867.f340c537750709e86127da01dede129e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695891766716"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695891766716"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695891766716"}]},"ts":"1695891766716"} 2023-09-28 09:02:46,718 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure b8236103834b88019e4dd6bb024b8adb, server=jenkins-hbase4.apache.org,40045,1695891669000}] 2023-09-28 09:02:46,720 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure f340c537750709e86127da01dede129e, server=jenkins-hbase4.apache.org,39195,1695891668910}] 2023-09-28 09:02:46,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-28 09:02:46,872 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b8236103834b88019e4dd6bb024b8adb 2023-09-28 09:02:46,872 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f340c537750709e86127da01dede129e 2023-09-28 09:02:46,872 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b8236103834b88019e4dd6bb024b8adb, disabling compactions & flushes 2023-09-28 09:02:46,872 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f340c537750709e86127da01dede129e, disabling compactions & flushes 2023-09-28 09:02:46,872 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695891754867.b8236103834b88019e4dd6bb024b8adb. 2023-09-28 09:02:46,872 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695891754867.f340c537750709e86127da01dede129e. 2023-09-28 09:02:46,872 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695891754867.f340c537750709e86127da01dede129e. 2023-09-28 09:02:46,872 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695891754867.b8236103834b88019e4dd6bb024b8adb. 2023-09-28 09:02:46,872 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695891754867.f340c537750709e86127da01dede129e. after waiting 0 ms 2023-09-28 09:02:46,872 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695891754867.f340c537750709e86127da01dede129e. 2023-09-28 09:02:46,872 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695891754867.b8236103834b88019e4dd6bb024b8adb. after waiting 0 ms 2023-09-28 09:02:46,872 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695891754867.b8236103834b88019e4dd6bb024b8adb. 2023-09-28 09:02:46,880 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testEmptyExportFileSystemState/b8236103834b88019e4dd6bb024b8adb/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-28 09:02:46,880 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testEmptyExportFileSystemState/f340c537750709e86127da01dede129e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-28 09:02:46,880 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 09:02:46,880 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 09:02:46,881 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695891754867.b8236103834b88019e4dd6bb024b8adb. 2023-09-28 09:02:46,882 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b8236103834b88019e4dd6bb024b8adb: 2023-09-28 09:02:46,882 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695891754867.f340c537750709e86127da01dede129e. 2023-09-28 09:02:46,882 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f340c537750709e86127da01dede129e: 2023-09-28 09:02:46,884 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b8236103834b88019e4dd6bb024b8adb 2023-09-28 09:02:46,884 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=b8236103834b88019e4dd6bb024b8adb, regionState=CLOSED 2023-09-28 09:02:46,884 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695891754867.b8236103834b88019e4dd6bb024b8adb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695891766884"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695891766884"}]},"ts":"1695891766884"} 2023-09-28 09:02:46,884 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f340c537750709e86127da01dede129e 2023-09-28 09:02:46,885 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=f340c537750709e86127da01dede129e, regionState=CLOSED 2023-09-28 09:02:46,885 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695891754867.f340c537750709e86127da01dede129e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695891766885"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695891766885"}]},"ts":"1695891766885"} 2023-09-28 09:02:46,889 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=101 2023-09-28 09:02:46,889 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure b8236103834b88019e4dd6bb024b8adb, server=jenkins-hbase4.apache.org,40045,1695891669000 in 167 msec 2023-09-28 09:02:46,889 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=100 2023-09-28 09:02:46,889 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure f340c537750709e86127da01dede129e, server=jenkins-hbase4.apache.org,39195,1695891668910 in 167 msec 2023-09-28 09:02:46,890 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b8236103834b88019e4dd6bb024b8adb, UNASSIGN in 178 msec 2023-09-28 09:02:46,891 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=100, resume processing ppid=99 2023-09-28 09:02:46,891 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f340c537750709e86127da01dede129e, UNASSIGN in 178 msec 2023-09-28 09:02:46,891 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695891766891"}]},"ts":"1695891766891"} 2023-09-28 09:02:46,893 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-09-28 09:02:46,895 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-09-28 09:02:46,896 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 192 msec 2023-09-28 09:02:47,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-28 09:02:47,010 INFO [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-09-28 09:02:47,010 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-09-28 09:02:47,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-28 09:02:47,014 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-28 09:02:47,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-09-28 09:02:47,014 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-28 09:02:47,016 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40311] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-09-28 09:02:47,018 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testEmptyExportFileSystemState/f340c537750709e86127da01dede129e 2023-09-28 09:02:47,018 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testEmptyExportFileSystemState/b8236103834b88019e4dd6bb024b8adb 2023-09-28 09:02:47,020 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testEmptyExportFileSystemState/b8236103834b88019e4dd6bb024b8adb/cf, FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testEmptyExportFileSystemState/b8236103834b88019e4dd6bb024b8adb/recovered.edits] 2023-09-28 09:02:47,020 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testEmptyExportFileSystemState/f340c537750709e86127da01dede129e/cf, FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testEmptyExportFileSystemState/f340c537750709e86127da01dede129e/recovered.edits] 2023-09-28 09:02:47,022 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-28 09:02:47,022 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-28 09:02:47,022 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-28 09:02:47,022 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-28 09:02:47,023 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-28 09:02:47,023 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-28 09:02:47,023 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-28 09:02:47,023 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-28 09:02:47,025 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testEmptyExportFileSystemState/b8236103834b88019e4dd6bb024b8adb/cf/7a02192510b1423eaba7d93788917b05 to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/archive/data/default/testtb-testEmptyExportFileSystemState/b8236103834b88019e4dd6bb024b8adb/cf/7a02192510b1423eaba7d93788917b05 2023-09-28 09:02:47,025 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testEmptyExportFileSystemState/f340c537750709e86127da01dede129e/cf/f35899a5613d4382a89b8b5fd5415f65 to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/archive/data/default/testtb-testEmptyExportFileSystemState/f340c537750709e86127da01dede129e/cf/f35899a5613d4382a89b8b5fd5415f65 2023-09-28 09:02:47,027 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-28 09:02:47,027 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 09:02:47,027 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-28 09:02:47,027 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-28 09:02:47,027 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 09:02:47,027 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 09:02:47,027 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-28 09:02:47,027 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 09:02:47,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-28 09:02:47,028 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testEmptyExportFileSystemState/b8236103834b88019e4dd6bb024b8adb/recovered.edits/9.seqid to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/archive/data/default/testtb-testEmptyExportFileSystemState/b8236103834b88019e4dd6bb024b8adb/recovered.edits/9.seqid 2023-09-28 09:02:47,028 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testEmptyExportFileSystemState/f340c537750709e86127da01dede129e/recovered.edits/9.seqid to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/archive/data/default/testtb-testEmptyExportFileSystemState/f340c537750709e86127da01dede129e/recovered.edits/9.seqid 2023-09-28 09:02:47,029 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testEmptyExportFileSystemState/b8236103834b88019e4dd6bb024b8adb 2023-09-28 09:02:47,029 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testEmptyExportFileSystemState/f340c537750709e86127da01dede129e 2023-09-28 09:02:47,029 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-28 09:02:47,030 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-28 09:02:47,030 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-09-28 09:02:47,034 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230928eb5deca192844a7485186488d915fe64 to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230928eb5deca192844a7485186488d915fe64 2023-09-28 09:02:47,035 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309287062f73297e64a29979425dc2b3fd0fd to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309287062f73297e64a29979425dc2b3fd0fd 2023-09-28 09:02:47,036 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-28 09:02:47,038 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-28 09:02:47,040 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-09-28 09:02:47,042 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-09-28 09:02:47,043 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-28 09:02:47,043 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-09-28 09:02:47,043 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1695891754867.f340c537750709e86127da01dede129e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695891767043"}]},"ts":"9223372036854775807"} 2023-09-28 09:02:47,044 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1695891754867.b8236103834b88019e4dd6bb024b8adb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695891767043"}]},"ts":"9223372036854775807"} 2023-09-28 09:02:47,045 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-28 09:02:47,045 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f340c537750709e86127da01dede129e, NAME => 'testtb-testEmptyExportFileSystemState,,1695891754867.f340c537750709e86127da01dede129e.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => b8236103834b88019e4dd6bb024b8adb, NAME => 'testtb-testEmptyExportFileSystemState,1,1695891754867.b8236103834b88019e4dd6bb024b8adb.', STARTKEY => '1', ENDKEY => ''}] 2023-09-28 09:02:47,045 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-09-28 09:02:47,045 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695891767045"}]},"ts":"9223372036854775807"} 2023-09-28 09:02:47,047 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-09-28 09:02:47,050 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-28 09:02:47,051 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 40 msec 2023-09-28 09:02:47,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-28 09:02:47,129 INFO [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-09-28 09:02:47,136 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-09-28 09:02:47,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:47,140 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-09-28 09:02:47,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-09-28 09:02:47,166 INFO [Listener at jenkins-hbase4.apache.org/39071] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=766 (was 759) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1698010877_17 at /127.0.0.1:40122 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2019770541_1 at /127.0.0.1:40452 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (32912118) connection to jenkins-hbase4.apache.org/172.31.14.131:35263 from appattempt_1695891675416_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (32912118) connection to jenkins-hbase4.apache.org/172.31.14.131:38547 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x3ff53656-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3ff53656-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3ff53656-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4606 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1698010877_17 at /127.0.0.1:36122 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1698010877_17 at /127.0.0.1:54150 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (32912118) connection to jenkins-hbase4.apache.org/172.31.14.131:46493 from appattempt_1695891675416_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x3ff53656-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2019770541_1 at /127.0.0.1:40786 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=927 (was 909) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=266 (was 246) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=4668 (was 4807) 2023-09-28 09:02:47,166 WARN [Listener at jenkins-hbase4.apache.org/39071] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-28 09:02:47,187 INFO [Listener at jenkins-hbase4.apache.org/39071] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=766, OpenFileDescriptor=927, MaxFileDescriptor=60000, SystemLoadAverage=266, ProcessCount=168, AvailableMemoryMB=4667 2023-09-28 09:02:47,187 WARN [Listener at jenkins-hbase4.apache.org/39071] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-28 09:02:47,189 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-28 09:02:47,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,192 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-09-28 09:02:47,193 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-09-28 09:02:47,193 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-28 09:02:47,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-28 09:02:47,195 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7e72eeb6de55ab4aff3d5368f21c3ff 2023-09-28 09:02:47,195 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/69ecec07762a6ae0171a8de741e97ead 2023-09-28 09:02:47,196 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7e72eeb6de55ab4aff3d5368f21c3ff empty. 2023-09-28 09:02:47,196 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/69ecec07762a6ae0171a8de741e97ead empty. 2023-09-28 09:02:47,196 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7e72eeb6de55ab4aff3d5368f21c3ff 2023-09-28 09:02:47,196 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/69ecec07762a6ae0171a8de741e97ead 2023-09-28 09:02:47,197 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-28 09:02:47,206 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-09-28 09:02:47,207 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => e7e72eeb6de55ab4aff3d5368f21c3ff, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695891767189.e7e72eeb6de55ab4aff3d5368f21c3ff.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp 2023-09-28 09:02:47,207 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 69ecec07762a6ae0171a8de741e97ead, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695891767189.69ecec07762a6ae0171a8de741e97ead.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp 2023-09-28 09:02:47,228 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695891767189.e7e72eeb6de55ab4aff3d5368f21c3ff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 09:02:47,228 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing e7e72eeb6de55ab4aff3d5368f21c3ff, disabling compactions & flushes 2023-09-28 09:02:47,228 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695891767189.e7e72eeb6de55ab4aff3d5368f21c3ff. 2023-09-28 09:02:47,228 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695891767189.e7e72eeb6de55ab4aff3d5368f21c3ff. 2023-09-28 09:02:47,228 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695891767189.e7e72eeb6de55ab4aff3d5368f21c3ff. after waiting 0 ms 2023-09-28 09:02:47,228 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695891767189.e7e72eeb6de55ab4aff3d5368f21c3ff. 2023-09-28 09:02:47,228 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695891767189.e7e72eeb6de55ab4aff3d5368f21c3ff. 2023-09-28 09:02:47,228 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for e7e72eeb6de55ab4aff3d5368f21c3ff: 2023-09-28 09:02:47,229 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695891767189.69ecec07762a6ae0171a8de741e97ead.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 09:02:47,229 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 69ecec07762a6ae0171a8de741e97ead, disabling compactions & flushes 2023-09-28 09:02:47,229 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695891767189.69ecec07762a6ae0171a8de741e97ead. 2023-09-28 09:02:47,229 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695891767189.69ecec07762a6ae0171a8de741e97ead. 2023-09-28 09:02:47,229 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695891767189.69ecec07762a6ae0171a8de741e97ead. after waiting 0 ms 2023-09-28 09:02:47,229 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695891767189.69ecec07762a6ae0171a8de741e97ead. 2023-09-28 09:02:47,229 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695891767189.69ecec07762a6ae0171a8de741e97ead. 2023-09-28 09:02:47,229 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 69ecec07762a6ae0171a8de741e97ead: 2023-09-28 09:02:47,232 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-09-28 09:02:47,233 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695891767189.e7e72eeb6de55ab4aff3d5368f21c3ff.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695891767232"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695891767232"}]},"ts":"1695891767232"} 2023-09-28 09:02:47,233 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695891767189.69ecec07762a6ae0171a8de741e97ead.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695891767232"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695891767232"}]},"ts":"1695891767232"} 2023-09-28 09:02:47,235 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-28 09:02:47,236 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-28 09:02:47,236 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695891767236"}]},"ts":"1695891767236"} 2023-09-28 09:02:47,238 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-09-28 09:02:47,242 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-28 09:02:47,243 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-28 09:02:47,243 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-28 09:02:47,243 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-28 09:02:47,243 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-28 09:02:47,244 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e7e72eeb6de55ab4aff3d5368f21c3ff, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=69ecec07762a6ae0171a8de741e97ead, ASSIGN}] 2023-09-28 09:02:47,246 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e7e72eeb6de55ab4aff3d5368f21c3ff, ASSIGN 2023-09-28 09:02:47,247 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=69ecec07762a6ae0171a8de741e97ead, ASSIGN 2023-09-28 09:02:47,247 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=69ecec07762a6ae0171a8de741e97ead, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40311,1695891668959; forceNewPlan=false, retain=false 2023-09-28 09:02:47,247 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e7e72eeb6de55ab4aff3d5368f21c3ff, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40045,1695891669000; forceNewPlan=false, retain=false 2023-09-28 09:02:47,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-28 09:02:47,397 INFO [jenkins-hbase4:40293] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-28 09:02:47,400 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=e7e72eeb6de55ab4aff3d5368f21c3ff, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:47,400 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=69ecec07762a6ae0171a8de741e97ead, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:47,401 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695891767189.e7e72eeb6de55ab4aff3d5368f21c3ff.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695891767400"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695891767400"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695891767400"}]},"ts":"1695891767400"} 2023-09-28 09:02:47,401 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695891767189.69ecec07762a6ae0171a8de741e97ead.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695891767400"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695891767400"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695891767400"}]},"ts":"1695891767400"} 2023-09-28 09:02:47,402 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure e7e72eeb6de55ab4aff3d5368f21c3ff, server=jenkins-hbase4.apache.org,40045,1695891669000}] 2023-09-28 09:02:47,403 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 69ecec07762a6ae0171a8de741e97ead, server=jenkins-hbase4.apache.org,40311,1695891668959}] 2023-09-28 09:02:47,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-28 09:02:47,557 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1695891767189.69ecec07762a6ae0171a8de741e97ead. 2023-09-28 09:02:47,557 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1695891767189.e7e72eeb6de55ab4aff3d5368f21c3ff. 2023-09-28 09:02:47,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 69ecec07762a6ae0171a8de741e97ead, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695891767189.69ecec07762a6ae0171a8de741e97ead.', STARTKEY => '1', ENDKEY => ''} 2023-09-28 09:02:47,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e7e72eeb6de55ab4aff3d5368f21c3ff, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695891767189.e7e72eeb6de55ab4aff3d5368f21c3ff.', STARTKEY => '', ENDKEY => '1'} 2023-09-28 09:02:47,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1695891767189.e7e72eeb6de55ab4aff3d5368f21c3ff. service=AccessControlService 2023-09-28 09:02:47,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1695891767189.69ecec07762a6ae0171a8de741e97ead. service=AccessControlService 2023-09-28 09:02:47,558 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 09:02:47,558 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 09:02:47,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp e7e72eeb6de55ab4aff3d5368f21c3ff 2023-09-28 09:02:47,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695891767189.e7e72eeb6de55ab4aff3d5368f21c3ff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 09:02:47,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 69ecec07762a6ae0171a8de741e97ead 2023-09-28 09:02:47,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e7e72eeb6de55ab4aff3d5368f21c3ff 2023-09-28 09:02:47,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695891767189.69ecec07762a6ae0171a8de741e97ead.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 09:02:47,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e7e72eeb6de55ab4aff3d5368f21c3ff 2023-09-28 09:02:47,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 69ecec07762a6ae0171a8de741e97ead 2023-09-28 09:02:47,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 69ecec07762a6ae0171a8de741e97ead 2023-09-28 09:02:47,560 INFO [StoreOpener-e7e72eeb6de55ab4aff3d5368f21c3ff-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e7e72eeb6de55ab4aff3d5368f21c3ff 2023-09-28 09:02:47,560 INFO [StoreOpener-69ecec07762a6ae0171a8de741e97ead-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 69ecec07762a6ae0171a8de741e97ead 2023-09-28 09:02:47,561 DEBUG [StoreOpener-69ecec07762a6ae0171a8de741e97ead-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithSkipTmp/69ecec07762a6ae0171a8de741e97ead/cf 2023-09-28 09:02:47,561 DEBUG [StoreOpener-e7e72eeb6de55ab4aff3d5368f21c3ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7e72eeb6de55ab4aff3d5368f21c3ff/cf 2023-09-28 09:02:47,561 DEBUG [StoreOpener-e7e72eeb6de55ab4aff3d5368f21c3ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7e72eeb6de55ab4aff3d5368f21c3ff/cf 2023-09-28 09:02:47,561 DEBUG [StoreOpener-69ecec07762a6ae0171a8de741e97ead-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithSkipTmp/69ecec07762a6ae0171a8de741e97ead/cf 2023-09-28 09:02:47,562 INFO [StoreOpener-69ecec07762a6ae0171a8de741e97ead-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 69ecec07762a6ae0171a8de741e97ead columnFamilyName cf 2023-09-28 09:02:47,562 INFO [StoreOpener-e7e72eeb6de55ab4aff3d5368f21c3ff-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e7e72eeb6de55ab4aff3d5368f21c3ff columnFamilyName cf 2023-09-28 09:02:47,563 INFO [StoreOpener-e7e72eeb6de55ab4aff3d5368f21c3ff-1] regionserver.HStore(310): Store=e7e72eeb6de55ab4aff3d5368f21c3ff/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 09:02:47,563 INFO [StoreOpener-69ecec07762a6ae0171a8de741e97ead-1] regionserver.HStore(310): Store=69ecec07762a6ae0171a8de741e97ead/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 09:02:47,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7e72eeb6de55ab4aff3d5368f21c3ff 2023-09-28 09:02:47,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithSkipTmp/69ecec07762a6ae0171a8de741e97ead 2023-09-28 09:02:47,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithSkipTmp/69ecec07762a6ae0171a8de741e97ead 2023-09-28 09:02:47,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7e72eeb6de55ab4aff3d5368f21c3ff 2023-09-28 09:02:47,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e7e72eeb6de55ab4aff3d5368f21c3ff 2023-09-28 09:02:47,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 69ecec07762a6ae0171a8de741e97ead 2023-09-28 09:02:47,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7e72eeb6de55ab4aff3d5368f21c3ff/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 09:02:47,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithSkipTmp/69ecec07762a6ae0171a8de741e97ead/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 09:02:47,570 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e7e72eeb6de55ab4aff3d5368f21c3ff; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67580266, jitterRate=0.007024437189102173}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 09:02:47,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e7e72eeb6de55ab4aff3d5368f21c3ff: 2023-09-28 09:02:47,570 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 69ecec07762a6ae0171a8de741e97ead; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63310067, jitterRate=-0.056606486439704895}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 09:02:47,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 69ecec07762a6ae0171a8de741e97ead: 2023-09-28 09:02:47,571 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1695891767189.e7e72eeb6de55ab4aff3d5368f21c3ff., pid=108, masterSystemTime=1695891767554 2023-09-28 09:02:47,571 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1695891767189.69ecec07762a6ae0171a8de741e97ead., pid=109, masterSystemTime=1695891767554 2023-09-28 09:02:47,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1695891767189.e7e72eeb6de55ab4aff3d5368f21c3ff. 2023-09-28 09:02:47,572 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1695891767189.e7e72eeb6de55ab4aff3d5368f21c3ff. 2023-09-28 09:02:47,573 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=e7e72eeb6de55ab4aff3d5368f21c3ff, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:47,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1695891767189.69ecec07762a6ae0171a8de741e97ead. 2023-09-28 09:02:47,573 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1695891767189.69ecec07762a6ae0171a8de741e97ead. 2023-09-28 09:02:47,573 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695891767189.e7e72eeb6de55ab4aff3d5368f21c3ff.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695891767573"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695891767573"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695891767573"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695891767573"}]},"ts":"1695891767573"} 2023-09-28 09:02:47,574 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=69ecec07762a6ae0171a8de741e97ead, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:47,574 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695891767189.69ecec07762a6ae0171a8de741e97ead.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695891767574"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695891767574"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695891767574"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695891767574"}]},"ts":"1695891767574"} 2023-09-28 09:02:47,577 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=106 2023-09-28 09:02:47,577 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure e7e72eeb6de55ab4aff3d5368f21c3ff, server=jenkins-hbase4.apache.org,40045,1695891669000 in 173 msec 2023-09-28 09:02:47,577 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=107 2023-09-28 09:02:47,577 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 69ecec07762a6ae0171a8de741e97ead, server=jenkins-hbase4.apache.org,40311,1695891668959 in 173 msec 2023-09-28 09:02:47,578 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e7e72eeb6de55ab4aff3d5368f21c3ff, ASSIGN in 333 msec 2023-09-28 09:02:47,579 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=107, resume processing ppid=105 2023-09-28 09:02:47,579 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=69ecec07762a6ae0171a8de741e97ead, ASSIGN in 333 msec 2023-09-28 09:02:47,579 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-28 09:02:47,579 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695891767579"}]},"ts":"1695891767579"} 2023-09-28 09:02:47,580 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-09-28 09:02:47,582 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-09-28 09:02:47,583 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-09-28 09:02:47,584 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40311] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-28 09:02:47,586 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 09:02:47,586 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 09:02:47,586 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 09:02:47,586 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 09:02:47,588 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-28 09:02:47,588 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-28 09:02:47,588 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-28 09:02:47,588 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-28 09:02:47,589 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 399 msec 2023-09-28 09:02:47,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-28 09:02:47,798 INFO [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-09-28 09:02:47,800 DEBUG [Listener at jenkins-hbase4.apache.org/39071] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,800 DEBUG [Listener at jenkins-hbase4.apache.org/39071] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695891767189.e7e72eeb6de55ab4aff3d5368f21c3ff. 2023-09-28 09:02:47,802 INFO [Listener at jenkins-hbase4.apache.org/39071] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-28 09:02:47,813 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-28 09:02:47,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695891767813 (current time:1695891767813). 2023-09-28 09:02:47,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-28 09:02:47,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] zookeeper.ReadOnlyZKClient(139): Connect 0x23f9e7c5 to 127.0.0.1:61959 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 09:02:47,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@56f1af20, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 09:02:47,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 09:02:47,823 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34874, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 09:02:47,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x23f9e7c5 to 127.0.0.1:61959 2023-09-28 09:02:47,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 09:02:47,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] zookeeper.ReadOnlyZKClient(139): Connect 0x2e3bfbf2 to 127.0.0.1:61959 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 09:02:47,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4210e63f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 09:02:47,834 DEBUG [hconnection-0x1943c9f2-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 09:02:47,837 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34882, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 09:02:47,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2e3bfbf2 to 127.0.0.1:61959 2023-09-28 09:02:47,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 09:02:47,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-28 09:02:47,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-28 09:02:47,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-28 09:02:47,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-28 09:02:47,845 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-28 09:02:47,846 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695892367846 2023-09-28 09:02:47,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-28 09:02:47,846 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,848 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-28 09:02:47,848 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-28 09:02:47,849 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-28 09:02:47,849 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-28 09:02:47,849 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-09-28 09:02:47,850 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-28 09:02:47,851 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695892367851 2023-09-28 09:02:47,863 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,863 INFO [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-28 09:02:47,864 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 09:02:47,865 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-28 09:02:47,865 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-28 09:02:47,866 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,866 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,867 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:02:47,867 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:02:47,867 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:47,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:02:47,867 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:02:47,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:02:47,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:02:47,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:02:47,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:02:47,868 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:47,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:02:47,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,868 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:47,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,868 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,868 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:47,868 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-28 09:02:47,868 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-28 09:02:47,869 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-28 09:02:47,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-28 09:02:47,869 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-28 09:02:47,869 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-28 09:02:47,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,869 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,869 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-28 09:02:47,869 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-28 09:02:47,869 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,869 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 09:02:47,869 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-28 09:02:47,869 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,871 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 09:02:47,871 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-28 09:02:47,872 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-28 09:02:47,872 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-28 09:02:47,871 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-28 09:02:47,872 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-28 09:02:47,872 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40045,1695891669000' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-28 09:02:47,872 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 09:02:47,872 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39195,1695891668910' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-28 09:02:47,873 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-28 09:02:47,874 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-28 09:02:47,874 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40311,1695891668959' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-28 09:02:47,880 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:47,880 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:47,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:02:47,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:02:47,881 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,881 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:47,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:02:47,881 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,881 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,881 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 09:02:47,881 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,881 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 09:02:47,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:02:47,882 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,882 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 09:02:47,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:47,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:47,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:47,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:02:47,883 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40045,1695891669000' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-28 09:02:47,883 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@73a447c2[Count = 1] remaining members to acquire global barrier 2023-09-28 09:02:47,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:47,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:02:47,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:02:47,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:02:47,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:02:47,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:47,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:47,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:47,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:02:47,885 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40311,1695891668959' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-28 09:02:47,885 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@73a447c2[Count = 0] remaining members to acquire global barrier 2023-09-28 09:02:47,885 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-28 09:02:47,885 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,886 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,886 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,886 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,887 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:47,887 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-28 09:02:47,887 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-28 09:02:47,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,887 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-28 09:02:47,887 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-28 09:02:47,887 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 09:02:47,887 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 09:02:47,887 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39195,1695891668910' in zk 2023-09-28 09:02:47,887 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:47,887 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-28 09:02:47,887 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695891767189.e7e72eeb6de55ab4aff3d5368f21c3ff. 2023-09-28 09:02:47,887 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 09:02:47,887 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 09:02:47,887 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695891767189.e7e72eeb6de55ab4aff3d5368f21c3ff. started... 2023-09-28 09:02:47,887 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695891767189.69ecec07762a6ae0171a8de741e97ead. 2023-09-28 09:02:47,887 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695891767189.69ecec07762a6ae0171a8de741e97ead. started... 2023-09-28 09:02:47,888 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e7e72eeb6de55ab4aff3d5368f21c3ff: 2023-09-28 09:02:47,889 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 69ecec07762a6ae0171a8de741e97ead: 2023-09-28 09:02:47,889 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695891767189.e7e72eeb6de55ab4aff3d5368f21c3ff.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,889 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695891767189.69ecec07762a6ae0171a8de741e97ead.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,889 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 09:02:47,889 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 09:02:47,889 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-28 09:02:47,889 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-28 09:02:47,890 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-28 09:02:47,890 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 09:02:47,890 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-28 09:02:47,901 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695891767189.69ecec07762a6ae0171a8de741e97ead. completed. 2023-09-28 09:02:47,901 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695891767189.69ecec07762a6ae0171a8de741e97ead. 2023-09-28 09:02:47,901 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 09:02:47,901 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 09:02:47,901 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:47,901 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-28 09:02:47,901 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40311,1695891668959' in zk 2023-09-28 09:02:47,903 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695891767189.e7e72eeb6de55ab4aff3d5368f21c3ff. completed. 2023-09-28 09:02:47,903 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695891767189.e7e72eeb6de55ab4aff3d5368f21c3ff. 2023-09-28 09:02:47,903 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 09:02:47,903 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 09:02:47,903 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:47,904 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-28 09:02:47,904 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40045,1695891669000' in zk 2023-09-28 09:02:47,904 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:47,904 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-28 09:02:47,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:47,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:02:47,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:02:47,904 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 09:02:47,904 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-28 09:02:47,906 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:47,906 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-28 09:02:47,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:02:47,906 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 09:02:47,906 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-28 09:02:47,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:02:47,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:47,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:47,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:47,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:02:47,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:47,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:47,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:47,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,40311,1695891668959': 2023-09-28 09:02:47,911 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40311,1695891668959' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-28 09:02:47,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:47,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:02:47,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:02:47,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:02:47,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:02:47,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:47,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:47,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:47,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:02:47,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:47,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:47,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:47,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,40045,1695891669000': 2023-09-28 09:02:47,914 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40045,1695891669000' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-28 09:02:47,914 INFO [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-28 09:02:47,914 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-28 09:02:47,914 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-28 09:02:47,914 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,914 INFO [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-28 09:02:47,916 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,916 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:02:47,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:02:47,916 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,916 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:02:47,916 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,916 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:02:47,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,917 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:02:47,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,917 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:47,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:02:47,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:02:47,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:02:47,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:02:47,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:02:47,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:02:47,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:02:47,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,917 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:47,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:02:47,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,918 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:47,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:47,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:47,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:47,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:02:47,920 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:47,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,920 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:47,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:47,921 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:47,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:47,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:47,924 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:02:47,924 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:02:47,924 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:47,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:02:47,924 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:02:47,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:02:47,924 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:02:47,924 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,924 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 09:02:47,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:02:47,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:02:47,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:02:47,924 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:02:47,924 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:02:47,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:02:47,924 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,924 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:02:47,927 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:02:47,927 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-28 09:02:47,927 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:47,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:02:47,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:02:47,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:02:47,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:02:47,927 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:47,927 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,927 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:47,927 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,927 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:47,927 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:47,927 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,927 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,928 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-28 09:02:47,940 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,941 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,949 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 09:02:47,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-28 09:02:47,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-28 09:02:47,950 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-28 09:02:47,956 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,957 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-28 09:02:47,957 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,957 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:47,957 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695891767846Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695891767940 (+94 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695891767940Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695891767940Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695891767944 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695891767951 (+7 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695891767957 (+6 ms) 2023-09-28 09:02:47,960 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-28 09:02:47,961 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 113 msec 2023-09-28 09:02:48,150 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 09:02:48,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-28 09:02:48,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-28 09:02:48,154 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40045] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1695891767189.e7e72eeb6de55ab4aff3d5368f21c3ff. with WAL disabled. Data may be lost in the event of a crash. 2023-09-28 09:02:48,155 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1695891767189.69ecec07762a6ae0171a8de741e97ead. with WAL disabled. Data may be lost in the event of a crash. 2023-09-28 09:02:48,158 DEBUG [Listener at jenkins-hbase4.apache.org/39071] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,158 DEBUG [Listener at jenkins-hbase4.apache.org/39071] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695891767189.e7e72eeb6de55ab4aff3d5368f21c3ff. 2023-09-28 09:02:48,158 INFO [Listener at jenkins-hbase4.apache.org/39071] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-28 09:02:48,168 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-28 09:02:48,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695891768168 (current time:1695891768168). 2023-09-28 09:02:48,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-28 09:02:48,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] zookeeper.ReadOnlyZKClient(139): Connect 0x309c1fbb to 127.0.0.1:61959 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 09:02:48,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@37175c03, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 09:02:48,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 09:02:48,180 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34898, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 09:02:48,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x309c1fbb to 127.0.0.1:61959 2023-09-28 09:02:48,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 09:02:48,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] zookeeper.ReadOnlyZKClient(139): Connect 0x6a271399 to 127.0.0.1:61959 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 09:02:48,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a16a8a1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 09:02:48,190 DEBUG [hconnection-0x376c0ca4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 09:02:48,192 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34902, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 09:02:48,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a271399 to 127.0.0.1:61959 2023-09-28 09:02:48,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 09:02:48,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-28 09:02:48,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-28 09:02:48,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-28 09:02:48,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-28 09:02:48,201 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-28 09:02:48,202 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695892368202 2023-09-28 09:02:48,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-28 09:02:48,202 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,203 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-28 09:02:48,203 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-28 09:02:48,204 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-28 09:02:48,204 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-28 09:02:48,205 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-09-28 09:02:48,206 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-28 09:02:48,207 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695892368207 2023-09-28 09:02:48,216 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,216 INFO [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-28 09:02:48,216 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 09:02:48,218 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-28 09:02:48,218 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-28 09:02:48,218 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,218 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,220 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:02:48,220 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:02:48,221 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:48,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:02:48,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:02:48,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:02:48,220 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:02:48,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:02:48,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:02:48,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:02:48,221 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:48,221 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:48,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,222 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:48,222 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,222 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-28 09:02:48,222 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,222 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-28 09:02:48,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-28 09:02:48,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-28 09:02:48,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,222 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-28 09:02:48,222 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-28 09:02:48,222 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-28 09:02:48,223 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,223 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-28 09:02:48,223 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 09:02:48,227 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,229 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-28 09:02:48,229 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-28 09:02:48,229 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,229 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-28 09:02:48,229 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-28 09:02:48,229 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 09:02:48,229 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 09:02:48,229 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39195,1695891668910' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-28 09:02:48,232 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-28 09:02:48,230 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-28 09:02:48,232 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-28 09:02:48,232 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-28 09:02:48,232 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40311,1695891668959' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-28 09:02:48,232 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40045,1695891669000' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-28 09:02:48,234 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:48,234 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:48,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:02:48,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:02:48,234 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,235 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:48,235 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,235 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,235 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 09:02:48,235 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 09:02:48,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:02:48,235 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:02:48,236 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,236 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 09:02:48,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:48,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:48,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:48,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:02:48,237 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40311,1695891668959' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-28 09:02:48,237 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@540d3c18[Count = 1] remaining members to acquire global barrier 2023-09-28 09:02:48,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:48,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:02:48,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:02:48,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:02:48,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:02:48,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:48,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:48,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:48,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:02:48,239 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40045,1695891669000' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-28 09:02:48,239 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@540d3c18[Count = 0] remaining members to acquire global barrier 2023-09-28 09:02:48,239 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-28 09:02:48,239 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,247 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,247 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,247 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,247 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-28 09:02:48,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,247 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-28 09:02:48,247 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-28 09:02:48,247 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-28 09:02:48,247 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39195,1695891668910' in zk 2023-09-28 09:02:48,247 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:48,248 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 09:02:48,248 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 09:02:48,248 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695891767189.69ecec07762a6ae0171a8de741e97ead. 2023-09-28 09:02:48,248 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 09:02:48,248 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 09:02:48,248 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695891767189.69ecec07762a6ae0171a8de741e97ead. started... 2023-09-28 09:02:48,248 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695891767189.e7e72eeb6de55ab4aff3d5368f21c3ff. 2023-09-28 09:02:48,248 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:48,248 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-28 09:02:48,248 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695891767189.e7e72eeb6de55ab4aff3d5368f21c3ff. started... 2023-09-28 09:02:48,248 INFO [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 69ecec07762a6ae0171a8de741e97ead 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-09-28 09:02:48,248 INFO [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e7e72eeb6de55ab4aff3d5368f21c3ff 1/1 column families, dataSize=65 B heapSize=400 B 2023-09-28 09:02:48,249 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-28 09:02:48,249 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 09:02:48,249 DEBUG [member: 'jenkins-hbase4.apache.org,39195,1695891668910' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-28 09:02:48,278 INFO [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023092879bbc3554a324874bfbde154471594a0 to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023092879bbc3554a324874bfbde154471594a0 2023-09-28 09:02:48,280 INFO [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230928dfa736cec03d4fcabbdf8aee3a3e992c to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230928dfa736cec03d4fcabbdf8aee3a3e992c 2023-09-28 09:02:48,294 INFO [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=65, hasBloomFilter=true, into tmp file hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7e72eeb6de55ab4aff3d5368f21c3ff/.tmp/cf/1ac6bef274834b978455ef448ddf78a7 2023-09-28 09:02:48,294 INFO [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.2 K, hasBloomFilter=true, into tmp file hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithSkipTmp/69ecec07762a6ae0171a8de741e97ead/.tmp/cf/79d51ef13fea453fb2814e2eb11996c5 2023-09-28 09:02:48,300 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7e72eeb6de55ab4aff3d5368f21c3ff/.tmp/cf/1ac6bef274834b978455ef448ddf78a7 as hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7e72eeb6de55ab4aff3d5368f21c3ff/cf/1ac6bef274834b978455ef448ddf78a7 2023-09-28 09:02:48,300 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithSkipTmp/69ecec07762a6ae0171a8de741e97ead/.tmp/cf/79d51ef13fea453fb2814e2eb11996c5 as hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithSkipTmp/69ecec07762a6ae0171a8de741e97ead/cf/79d51ef13fea453fb2814e2eb11996c5 2023-09-28 09:02:48,304 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 09:02:48,304 INFO [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7e72eeb6de55ab4aff3d5368f21c3ff/cf/1ac6bef274834b978455ef448ddf78a7, entries=1, sequenceid=6, filesize=5.1 K 2023-09-28 09:02:48,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-28 09:02:48,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-28 09:02:48,305 INFO [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithSkipTmp/69ecec07762a6ae0171a8de741e97ead/cf/79d51ef13fea453fb2814e2eb11996c5, entries=49, sequenceid=6, filesize=13.7 K 2023-09-28 09:02:48,305 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-28 09:02:48,305 INFO [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for e7e72eeb6de55ab4aff3d5368f21c3ff in 57ms, sequenceid=6, compaction requested=false 2023-09-28 09:02:48,305 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-28 09:02:48,306 INFO [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for 69ecec07762a6ae0171a8de741e97ead in 58ms, sequenceid=6, compaction requested=false 2023-09-28 09:02:48,306 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-28 09:02:48,307 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e7e72eeb6de55ab4aff3d5368f21c3ff: 2023-09-28 09:02:48,307 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 69ecec07762a6ae0171a8de741e97ead: 2023-09-28 09:02:48,308 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695891767189.e7e72eeb6de55ab4aff3d5368f21c3ff.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,308 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695891767189.69ecec07762a6ae0171a8de741e97ead.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,308 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 09:02:48,308 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 09:02:48,308 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7e72eeb6de55ab4aff3d5368f21c3ff/cf/1ac6bef274834b978455ef448ddf78a7] hfiles 2023-09-28 09:02:48,308 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithSkipTmp/69ecec07762a6ae0171a8de741e97ead/cf/79d51ef13fea453fb2814e2eb11996c5] hfiles 2023-09-28 09:02:48,308 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7e72eeb6de55ab4aff3d5368f21c3ff/cf/1ac6bef274834b978455ef448ddf78a7 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,308 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithSkipTmp/69ecec07762a6ae0171a8de741e97ead/cf/79d51ef13fea453fb2814e2eb11996c5 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,315 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695891767189.e7e72eeb6de55ab4aff3d5368f21c3ff. completed. 2023-09-28 09:02:48,315 DEBUG [rs(jenkins-hbase4.apache.org,40045,1695891669000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695891767189.e7e72eeb6de55ab4aff3d5368f21c3ff. 2023-09-28 09:02:48,315 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 09:02:48,315 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 09:02:48,315 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:48,315 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-28 09:02:48,315 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40045,1695891669000' in zk 2023-09-28 09:02:48,315 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695891767189.69ecec07762a6ae0171a8de741e97ead. completed. 2023-09-28 09:02:48,315 DEBUG [rs(jenkins-hbase4.apache.org,40311,1695891668959)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695891767189.69ecec07762a6ae0171a8de741e97ead. 2023-09-28 09:02:48,315 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 09:02:48,315 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 09:02:48,316 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:48,316 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-28 09:02:48,316 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40311,1695891668959' in zk 2023-09-28 09:02:48,317 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:48,317 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-28 09:02:48,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:48,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:02:48,317 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 09:02:48,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:02:48,317 DEBUG [member: 'jenkins-hbase4.apache.org,40045,1695891669000' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-28 09:02:48,320 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:48,320 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-28 09:02:48,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:02:48,320 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 09:02:48,320 DEBUG [member: 'jenkins-hbase4.apache.org,40311,1695891668959' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-28 09:02:48,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:02:48,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:48,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:48,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:48,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:02:48,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:48,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:48,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:48,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,40045,1695891669000': 2023-09-28 09:02:48,325 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40045,1695891669000' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-28 09:02:48,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:48,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:02:48,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:02:48,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:02:48,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:02:48,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:48,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:48,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:48,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:02:48,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:48,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:48,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:48,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,40311,1695891668959': 2023-09-28 09:02:48,328 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40311,1695891668959' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-28 09:02:48,328 INFO [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-28 09:02:48,328 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-28 09:02:48,328 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-28 09:02:48,328 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,328 INFO [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-28 09:02:48,331 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,331 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,331 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,331 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:02:48,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,331 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:02:48,331 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 09:02:48,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 09:02:48,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:02:48,331 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:02:48,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:02:48,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,331 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:48,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 09:02:48,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:02:48,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:02:48,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:02:48,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:02:48,332 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:48,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,333 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:48,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 09:02:48,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:48,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:48,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:48,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 09:02:48,334 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:48,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,335 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:48,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:48,335 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:48,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:48,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:48,338 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:48,338 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,338 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:48,338 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:48,338 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:02:48,338 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:02:48,338 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,338 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 09:02:48,338 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:02:48,338 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:02:48,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:02:48,338 DEBUG [(jenkins-hbase4.apache.org,40293,1695891667656)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 09:02:48,338 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 09:02:48,338 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:02:48,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:02:48,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 09:02:48,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:02:48,340 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:02:48,338 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,340 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:02:48,341 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 09:02:48,341 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,341 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:02:48,341 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-28 09:02:48,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:02:48,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:02:48,341 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:02:48,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:02:48,341 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 09:02:48,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 09:02:48,342 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230928dfa736cec03d4fcabbdf8aee3a3e992c, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023092879bbc3554a324874bfbde154471594a0] mob files 2023-09-28 09:02:48,342 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230928dfa736cec03d4fcabbdf8aee3a3e992c 2023-09-28 09:02:48,342 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023092879bbc3554a324874bfbde154471594a0 2023-09-28 09:02:48,349 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,349 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,370 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,371 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-28 09:02:48,371 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,372 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,372 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695891768202Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695891768348 (+146 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695891768349 (+1 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1695891768349Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1695891768354 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695891768364 (+10 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695891768371 (+7 ms) 2023-09-28 09:02:48,375 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-28 09:02:48,376 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 172 msec 2023-09-28 09:02:48,505 DEBUG [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 09:02:48,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-28 09:02:48,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-28 09:02:48,507 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/export-test/export-1695891768507 2023-09-28 09:02:48,507 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:39781, tgtDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/export-test/export-1695891768507, rawTgtDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/export-test/export-1695891768507, srcFsUri=hdfs://localhost:39781, srcDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba 2023-09-28 09:02:48,530 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39781, inputRoot=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba 2023-09-28 09:02:48,531 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1927852871_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/export-test/export-1695891768507, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/export-test/export-1695891768507/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,531 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39781, inputRoot=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba, snapshotDir=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-09-28 09:02:48,541 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/export-test/export-1695891768507/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:02:48,559 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-28 09:02:48,559 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-28 09:02:48,560 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-28 09:02:48,560 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-28 09:02:49,439 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/hadoop-3185633810824131091.jar 2023-09-28 09:02:49,440 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-28 09:02:49,440 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-28 09:02:49,506 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/hadoop-2935401724012533981.jar 2023-09-28 09:02:49,507 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-28 09:02:49,507 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-28 09:02:49,508 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-28 09:02:49,508 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-28 09:02:49,508 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-28 09:02:49,509 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-28 09:02:49,509 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-28 09:02:49,509 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-28 09:02:49,510 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-28 09:02:49,510 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-28 09:02:49,510 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-28 09:02:49,511 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-28 09:02:49,511 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-28 09:02:49,512 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-28 09:02:49,512 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-28 09:02:49,512 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-28 09:02:49,513 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 09:02:49,513 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 09:02:49,514 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 09:02:49,514 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 09:02:49,514 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 09:02:49,515 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 09:02:49,515 DEBUG [Listener at jenkins-hbase4.apache.org/39071] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 09:02:49,871 WARN [Listener at jenkins-hbase4.apache.org/39071] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-28 09:02:49,872 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-09-28 09:02:49,874 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-09-28 09:02:50,957 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 09:02:50,957 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 09:02:50,959 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695891675416_0006_000001 (auth:SIMPLE) 2023-09-28 09:02:51,080 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695891675416_0007_000001 (auth:SIMPLE) 2023-09-28 09:02:52,465 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-28 09:02:55,007 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695891675416_0007_000001 (auth:SIMPLE) 2023-09-28 09:02:57,238 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695891675416_0007_000001 (auth:SIMPLE) 2023-09-28 09:02:59,953 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695891675416_0007_000001 (auth:SIMPLE) 2023-09-28 09:03:01,044 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-28 09:03:01,044 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-28 09:03:01,059 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:03:01,059 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-28 09:03:01,059 INFO [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-28 09:03:01,059 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1698010877_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:03:01,060 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(367): hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-28 09:03:01,060 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(367): hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-28 09:03:01,060 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1698010877_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/export-test/export-1695891768507/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/export-test/export-1695891768507/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:03:01,060 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(367): hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/export-test/export-1695891768507/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-28 09:03:01,060 DEBUG [Listener at jenkins-hbase4.apache.org/39071] snapshot.TestExportSnapshot(367): hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/export-test/export-1695891768507/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-28 09:03:01,066 INFO [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 09:03:01,067 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 09:03:01,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 09:03:01,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-28 09:03:01,071 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695891781071"}]},"ts":"1695891781071"} 2023-09-28 09:03:01,072 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-09-28 09:03:01,073 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-09-28 09:03:01,074 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e7e72eeb6de55ab4aff3d5368f21c3ff, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=69ecec07762a6ae0171a8de741e97ead, UNASSIGN}] 2023-09-28 09:03:01,076 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e7e72eeb6de55ab4aff3d5368f21c3ff, UNASSIGN 2023-09-28 09:03:01,076 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=69ecec07762a6ae0171a8de741e97ead, UNASSIGN 2023-09-28 09:03:01,077 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=e7e72eeb6de55ab4aff3d5368f21c3ff, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:03:01,077 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=69ecec07762a6ae0171a8de741e97ead, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:03:01,077 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695891767189.e7e72eeb6de55ab4aff3d5368f21c3ff.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695891781077"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695891781077"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695891781077"}]},"ts":"1695891781077"} 2023-09-28 09:03:01,077 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695891767189.69ecec07762a6ae0171a8de741e97ead.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695891781077"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695891781077"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695891781077"}]},"ts":"1695891781077"} 2023-09-28 09:03:01,078 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure e7e72eeb6de55ab4aff3d5368f21c3ff, server=jenkins-hbase4.apache.org,40045,1695891669000}] 2023-09-28 09:03:01,079 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 69ecec07762a6ae0171a8de741e97ead, server=jenkins-hbase4.apache.org,40311,1695891668959}] 2023-09-28 09:03:01,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-28 09:03:01,230 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e7e72eeb6de55ab4aff3d5368f21c3ff 2023-09-28 09:03:01,230 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 69ecec07762a6ae0171a8de741e97ead 2023-09-28 09:03:01,230 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e7e72eeb6de55ab4aff3d5368f21c3ff, disabling compactions & flushes 2023-09-28 09:03:01,230 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 69ecec07762a6ae0171a8de741e97ead, disabling compactions & flushes 2023-09-28 09:03:01,230 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695891767189.e7e72eeb6de55ab4aff3d5368f21c3ff. 2023-09-28 09:03:01,231 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695891767189.69ecec07762a6ae0171a8de741e97ead. 2023-09-28 09:03:01,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695891767189.e7e72eeb6de55ab4aff3d5368f21c3ff. 2023-09-28 09:03:01,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695891767189.69ecec07762a6ae0171a8de741e97ead. 2023-09-28 09:03:01,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695891767189.e7e72eeb6de55ab4aff3d5368f21c3ff. after waiting 0 ms 2023-09-28 09:03:01,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695891767189.69ecec07762a6ae0171a8de741e97ead. after waiting 0 ms 2023-09-28 09:03:01,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695891767189.69ecec07762a6ae0171a8de741e97ead. 2023-09-28 09:03:01,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695891767189.e7e72eeb6de55ab4aff3d5368f21c3ff. 2023-09-28 09:03:01,241 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7e72eeb6de55ab4aff3d5368f21c3ff/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-28 09:03:01,241 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/default/testtb-testExportFileSystemStateWithSkipTmp/69ecec07762a6ae0171a8de741e97ead/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-28 09:03:01,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 09:03:01,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 09:03:01,243 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695891767189.e7e72eeb6de55ab4aff3d5368f21c3ff. 2023-09-28 09:03:01,243 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e7e72eeb6de55ab4aff3d5368f21c3ff: 2023-09-28 09:03:01,243 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695891767189.69ecec07762a6ae0171a8de741e97ead. 2023-09-28 09:03:01,243 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 69ecec07762a6ae0171a8de741e97ead: 2023-09-28 09:03:01,245 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 69ecec07762a6ae0171a8de741e97ead 2023-09-28 09:03:01,245 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=69ecec07762a6ae0171a8de741e97ead, regionState=CLOSED 2023-09-28 09:03:01,245 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695891767189.69ecec07762a6ae0171a8de741e97ead.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695891781245"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695891781245"}]},"ts":"1695891781245"} 2023-09-28 09:03:01,245 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e7e72eeb6de55ab4aff3d5368f21c3ff 2023-09-28 09:03:01,246 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=e7e72eeb6de55ab4aff3d5368f21c3ff, regionState=CLOSED 2023-09-28 09:03:01,246 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695891767189.e7e72eeb6de55ab4aff3d5368f21c3ff.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695891781246"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695891781246"}]},"ts":"1695891781246"} 2023-09-28 09:03:01,248 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-09-28 09:03:01,248 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 69ecec07762a6ae0171a8de741e97ead, server=jenkins-hbase4.apache.org,40311,1695891668959 in 168 msec 2023-09-28 09:03:01,249 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=115 2023-09-28 09:03:01,249 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure e7e72eeb6de55ab4aff3d5368f21c3ff, server=jenkins-hbase4.apache.org,40045,1695891669000 in 169 msec 2023-09-28 09:03:01,249 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=69ecec07762a6ae0171a8de741e97ead, UNASSIGN in 174 msec 2023-09-28 09:03:01,250 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=115, resume processing ppid=114 2023-09-28 09:03:01,250 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e7e72eeb6de55ab4aff3d5368f21c3ff, UNASSIGN in 175 msec 2023-09-28 09:03:01,251 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695891781251"}]},"ts":"1695891781251"} 2023-09-28 09:03:01,252 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-09-28 09:03:01,253 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-09-28 09:03:01,255 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 187 msec 2023-09-28 09:03:01,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-28 09:03:01,373 INFO [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-09-28 09:03:01,374 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 09:03:01,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 09:03:01,376 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 09:03:01,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 09:03:01,377 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 09:03:01,379 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40311] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 09:03:01,381 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7e72eeb6de55ab4aff3d5368f21c3ff 2023-09-28 09:03:01,381 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/69ecec07762a6ae0171a8de741e97ead 2023-09-28 09:03:01,382 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 09:03:01,382 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 09:03:01,382 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 09:03:01,382 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 09:03:01,383 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-28 09:03:01,383 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-28 09:03:01,383 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-28 09:03:01,383 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-28 09:03:01,384 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7e72eeb6de55ab4aff3d5368f21c3ff/cf, FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7e72eeb6de55ab4aff3d5368f21c3ff/recovered.edits] 2023-09-28 09:03:01,384 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 09:03:01,384 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 09:03:01,384 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 09:03:01,384 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 09:03:01,384 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 09:03:01,384 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 09:03:01,384 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 09:03:01,384 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 09:03:01,384 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/69ecec07762a6ae0171a8de741e97ead/cf, FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/69ecec07762a6ae0171a8de741e97ead/recovered.edits] 2023-09-28 09:03:01,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-28 09:03:01,388 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7e72eeb6de55ab4aff3d5368f21c3ff/cf/1ac6bef274834b978455ef448ddf78a7 to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7e72eeb6de55ab4aff3d5368f21c3ff/cf/1ac6bef274834b978455ef448ddf78a7 2023-09-28 09:03:01,388 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/69ecec07762a6ae0171a8de741e97ead/cf/79d51ef13fea453fb2814e2eb11996c5 to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/69ecec07762a6ae0171a8de741e97ead/cf/79d51ef13fea453fb2814e2eb11996c5 2023-09-28 09:03:01,392 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7e72eeb6de55ab4aff3d5368f21c3ff/recovered.edits/9.seqid to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7e72eeb6de55ab4aff3d5368f21c3ff/recovered.edits/9.seqid 2023-09-28 09:03:01,392 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/69ecec07762a6ae0171a8de741e97ead/recovered.edits/9.seqid to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/69ecec07762a6ae0171a8de741e97ead/recovered.edits/9.seqid 2023-09-28 09:03:01,392 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7e72eeb6de55ab4aff3d5368f21c3ff 2023-09-28 09:03:01,392 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/69ecec07762a6ae0171a8de741e97ead 2023-09-28 09:03:01,392 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-28 09:03:01,393 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-28 09:03:01,394 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-09-28 09:03:01,397 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230928dfa736cec03d4fcabbdf8aee3a3e992c to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230928dfa736cec03d4fcabbdf8aee3a3e992c 2023-09-28 09:03:01,398 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023092879bbc3554a324874bfbde154471594a0 to hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023092879bbc3554a324874bfbde154471594a0 2023-09-28 09:03:01,399 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-28 09:03:01,400 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 09:03:01,403 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-09-28 09:03:01,405 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-09-28 09:03:01,406 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 09:03:01,406 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-09-28 09:03:01,406 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695891767189.e7e72eeb6de55ab4aff3d5368f21c3ff.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695891781406"}]},"ts":"9223372036854775807"} 2023-09-28 09:03:01,406 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695891767189.69ecec07762a6ae0171a8de741e97ead.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695891781406"}]},"ts":"9223372036854775807"} 2023-09-28 09:03:01,408 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-28 09:03:01,408 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e7e72eeb6de55ab4aff3d5368f21c3ff, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695891767189.e7e72eeb6de55ab4aff3d5368f21c3ff.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 69ecec07762a6ae0171a8de741e97ead, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695891767189.69ecec07762a6ae0171a8de741e97ead.', STARTKEY => '1', ENDKEY => ''}] 2023-09-28 09:03:01,408 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-09-28 09:03:01,408 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695891781408"}]},"ts":"9223372036854775807"} 2023-09-28 09:03:01,410 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-09-28 09:03:01,412 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 09:03:01,413 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 38 msec 2023-09-28 09:03:01,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-28 09:03:01,487 INFO [Listener at jenkins-hbase4.apache.org/39071] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-09-28 09:03:01,494 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-28 09:03:01,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:03:01,497 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-28 09:03:01,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40293] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 09:03:01,524 INFO [Listener at jenkins-hbase4.apache.org/39071] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=766 (was 766), OpenFileDescriptor=917 (was 927), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=239 (was 266), ProcessCount=168 (was 168), AvailableMemoryMB=4581 (was 4667) 2023-09-28 09:03:01,524 WARN [Listener at jenkins-hbase4.apache.org/39071] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-28 09:03:01,524 INFO [Listener at jenkins-hbase4.apache.org/39071] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-09-28 09:03:01,534 INFO [Listener at jenkins-hbase4.apache.org/39071] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-28 09:03:06,130 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695891675416_0007_000001 (auth:SIMPLE) 2023-09-28 09:03:06,812 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-28 09:03:15,657 INFO [Listener at jenkins-hbase4.apache.org/39071] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-28 09:03:29,773 ERROR [Thread[Thread-408,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-28 09:03:29,774 INFO [Listener at jenkins-hbase4.apache.org/39071] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-28 09:03:29,883 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-09-28 09:03:29,892 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-09-28 09:03:29,894 ERROR [Thread[Thread-418,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-28 09:03:29,903 INFO [Listener at jenkins-hbase4.apache.org/39071] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-28 09:03:30,007 ERROR [Thread[Thread-383,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-28 09:03:30,007 INFO [Listener at jenkins-hbase4.apache.org/39071] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-09-28 09:03:30,007 INFO [Listener at jenkins-hbase4.apache.org/39071] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-09-28 09:03:30,007 INFO [Listener at jenkins-hbase4.apache.org/39071] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-09-28 09:03:30,007 DEBUG [Listener at jenkins-hbase4.apache.org/39071] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5664efd5 to 127.0.0.1:61959 2023-09-28 09:03:30,007 DEBUG [Listener at jenkins-hbase4.apache.org/39071] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 09:03:30,007 DEBUG [Listener at jenkins-hbase4.apache.org/39071] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-09-28 09:03:30,007 DEBUG [Listener at jenkins-hbase4.apache.org/39071] util.JVMClusterUtil(257): Found active master hash=1556229407, stopped=false 2023-09-28 09:03:30,008 DEBUG [Listener at jenkins-hbase4.apache.org/39071] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 09:03:30,008 DEBUG [Listener at jenkins-hbase4.apache.org/39071] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-28 09:03:30,008 INFO [Listener at jenkins-hbase4.apache.org/39071] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,40293,1695891667656 2023-09-28 09:03:30,009 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-28 09:03:30,009 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-28 09:03:30,009 INFO [Listener at jenkins-hbase4.apache.org/39071] procedure2.ProcedureExecutor(628): Stopping 2023-09-28 09:03:30,009 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-28 09:03:30,009 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-28 09:03:30,009 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-28 09:03:30,010 DEBUG [Listener at jenkins-hbase4.apache.org/39071] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1ce94ec2 to 127.0.0.1:61959 2023-09-28 09:03:30,010 DEBUG [Listener at jenkins-hbase4.apache.org/39071] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 09:03:30,010 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-28 09:03:30,010 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-28 09:03:30,010 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-28 09:03:30,010 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-28 09:03:30,010 INFO [Listener at jenkins-hbase4.apache.org/39071] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39195,1695891668910' ***** 2023-09-28 09:03:30,011 DEBUG [Listener at jenkins-hbase4.apache.org/39071] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 09:03:30,011 INFO [Listener at jenkins-hbase4.apache.org/39071] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-28 09:03:30,011 INFO [Listener at jenkins-hbase4.apache.org/39071] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,40311,1695891668959' ***** 2023-09-28 09:03:30,011 DEBUG [Listener at jenkins-hbase4.apache.org/39071] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 09:03:30,011 INFO [Listener at jenkins-hbase4.apache.org/39071] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-28 09:03:30,011 INFO [Listener at jenkins-hbase4.apache.org/39071] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,40045,1695891669000' ***** 2023-09-28 09:03:30,011 DEBUG [Listener at jenkins-hbase4.apache.org/39071] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 09:03:30,011 INFO [Listener at jenkins-hbase4.apache.org/39071] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-28 09:03:30,011 INFO [RS:1;jenkins-hbase4:40311] regionserver.HeapMemoryManager(220): Stopping 2023-09-28 09:03:30,012 INFO [RS:2;jenkins-hbase4:40045] regionserver.HeapMemoryManager(220): Stopping 2023-09-28 09:03:30,012 INFO [RS:0;jenkins-hbase4:39195] regionserver.HeapMemoryManager(220): Stopping 2023-09-28 09:03:30,012 INFO [RS:1;jenkins-hbase4:40311] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-28 09:03:30,012 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-28 09:03:30,012 INFO [RS:1;jenkins-hbase4:40311] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-28 09:03:30,012 INFO [RS:0;jenkins-hbase4:39195] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-28 09:03:30,012 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-28 09:03:30,012 INFO [RS:0;jenkins-hbase4:39195] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-28 09:03:30,012 INFO [RS:1;jenkins-hbase4:40311] regionserver.HRegionServer(3305): Received CLOSE for fc82fa152d0901260f95b1e6be2f3488 2023-09-28 09:03:30,012 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-28 09:03:30,012 INFO [RS:0;jenkins-hbase4:39195] regionserver.HRegionServer(3305): Received CLOSE for e02133285b6f183c0299d48a8ce537ee 2023-09-28 09:03:30,012 INFO [RS:2;jenkins-hbase4:40045] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-28 09:03:30,012 INFO [RS:2;jenkins-hbase4:40045] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-28 09:03:30,012 INFO [RS:2;jenkins-hbase4:40045] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:03:30,012 INFO [RS:1;jenkins-hbase4:40311] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:03:30,012 INFO [RS:0;jenkins-hbase4:39195] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:03:30,012 DEBUG [RS:2;jenkins-hbase4:40045] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2c233932 to 127.0.0.1:61959 2023-09-28 09:03:30,013 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fc82fa152d0901260f95b1e6be2f3488, disabling compactions & flushes 2023-09-28 09:03:30,012 DEBUG [RS:0;jenkins-hbase4:39195] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1a0467bd to 127.0.0.1:61959 2023-09-28 09:03:30,012 DEBUG [RS:1;jenkins-hbase4:40311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1a903caf to 127.0.0.1:61959 2023-09-28 09:03:30,014 DEBUG [RS:0;jenkins-hbase4:39195] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 09:03:30,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e02133285b6f183c0299d48a8ce537ee, disabling compactions & flushes 2023-09-28 09:03:30,013 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695891671834.fc82fa152d0901260f95b1e6be2f3488. 2023-09-28 09:03:30,015 INFO [RS:0;jenkins-hbase4:39195] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-28 09:03:30,013 DEBUG [RS:2;jenkins-hbase4:40045] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 09:03:30,015 DEBUG [RS:0;jenkins-hbase4:39195] regionserver.HRegionServer(1478): Online Regions={e02133285b6f183c0299d48a8ce537ee=hbase:namespace,,1695891671097.e02133285b6f183c0299d48a8ce537ee.} 2023-09-28 09:03:30,017 INFO [RS:2;jenkins-hbase4:40045] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,40045,1695891669000; all regions closed. 2023-09-28 09:03:30,015 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695891671834.fc82fa152d0901260f95b1e6be2f3488. 2023-09-28 09:03:30,015 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695891671097.e02133285b6f183c0299d48a8ce537ee. 2023-09-28 09:03:30,014 DEBUG [RS:1;jenkins-hbase4:40311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 09:03:30,017 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695891671097.e02133285b6f183c0299d48a8ce537ee. 2023-09-28 09:03:30,017 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695891671834.fc82fa152d0901260f95b1e6be2f3488. after waiting 0 ms 2023-09-28 09:03:30,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695891671097.e02133285b6f183c0299d48a8ce537ee. after waiting 0 ms 2023-09-28 09:03:30,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695891671834.fc82fa152d0901260f95b1e6be2f3488. 2023-09-28 09:03:30,018 INFO [RS:1;jenkins-hbase4:40311] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-28 09:03:30,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695891671097.e02133285b6f183c0299d48a8ce537ee. 2023-09-28 09:03:30,018 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing fc82fa152d0901260f95b1e6be2f3488 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-09-28 09:03:30,018 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing e02133285b6f183c0299d48a8ce537ee 1/1 column families, dataSize=78 B heapSize=488 B 2023-09-28 09:03:30,018 INFO [RS:1;jenkins-hbase4:40311] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-28 09:03:30,018 INFO [RS:1;jenkins-hbase4:40311] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-28 09:03:30,018 INFO [RS:1;jenkins-hbase4:40311] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-09-28 09:03:30,018 DEBUG [RS:0;jenkins-hbase4:39195] regionserver.HRegionServer(1504): Waiting on e02133285b6f183c0299d48a8ce537ee 2023-09-28 09:03:30,019 INFO [RS:1;jenkins-hbase4:40311] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-09-28 09:03:30,019 DEBUG [RS:1;jenkins-hbase4:40311] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, fc82fa152d0901260f95b1e6be2f3488=hbase:acl,,1695891671834.fc82fa152d0901260f95b1e6be2f3488.} 2023-09-28 09:03:30,019 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-28 09:03:30,020 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-28 09:03:30,020 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-28 09:03:30,020 DEBUG [RS:1;jenkins-hbase4:40311] regionserver.HRegionServer(1504): Waiting on 1588230740, fc82fa152d0901260f95b1e6be2f3488 2023-09-28 09:03:30,020 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-28 09:03:30,020 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-28 09:03:30,020 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-09-28 09:03:30,030 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-28 09:03:30,030 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-28 09:03:30,030 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-28 09:03:30,038 DEBUG [RS:2;jenkins-hbase4:40045] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/oldWALs 2023-09-28 09:03:30,038 INFO [RS:2;jenkins-hbase4:40045] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40045%2C1695891669000:(num 1695891670673) 2023-09-28 09:03:30,038 DEBUG [RS:2;jenkins-hbase4:40045] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 09:03:30,038 INFO [RS:2;jenkins-hbase4:40045] regionserver.LeaseManager(133): Closed leases 2023-09-28 09:03:30,039 INFO [RS:2;jenkins-hbase4:40045] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-28 09:03:30,040 INFO [RS:2;jenkins-hbase4:40045] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-28 09:03:30,040 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-28 09:03:30,040 INFO [RS:2;jenkins-hbase4:40045] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-28 09:03:30,040 INFO [RS:2;jenkins-hbase4:40045] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-28 09:03:30,049 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/hbase/meta/1588230740/.tmp/info/979233733f2b475ea376ee6c2481bbd8 2023-09-28 09:03:30,049 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/hbase/acl/fc82fa152d0901260f95b1e6be2f3488/.tmp/l/6ec8b84003eb45f7ba9b0998a58f6aa2 2023-09-28 09:03:30,050 INFO [RS:2;jenkins-hbase4:40045] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40045 2023-09-28 09:03:30,054 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/hbase/namespace/e02133285b6f183c0299d48a8ce537ee/.tmp/info/f2772aa97249440481a55c4c45bb7d0d 2023-09-28 09:03:30,055 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6ec8b84003eb45f7ba9b0998a58f6aa2 2023-09-28 09:03:30,056 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 979233733f2b475ea376ee6c2481bbd8 2023-09-28 09:03:30,056 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/hbase/acl/fc82fa152d0901260f95b1e6be2f3488/.tmp/l/6ec8b84003eb45f7ba9b0998a58f6aa2 as hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/hbase/acl/fc82fa152d0901260f95b1e6be2f3488/l/6ec8b84003eb45f7ba9b0998a58f6aa2 2023-09-28 09:03:30,057 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:03:30,057 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:03:30,057 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-28 09:03:30,057 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40045,1695891669000 2023-09-28 09:03:30,057 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-28 09:03:30,057 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-28 09:03:30,057 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-28 09:03:30,059 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40045,1695891669000] 2023-09-28 09:03:30,060 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40045,1695891669000; numProcessing=1 2023-09-28 09:03:30,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/hbase/namespace/e02133285b6f183c0299d48a8ce537ee/.tmp/info/f2772aa97249440481a55c4c45bb7d0d as hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/hbase/namespace/e02133285b6f183c0299d48a8ce537ee/info/f2772aa97249440481a55c4c45bb7d0d 2023-09-28 09:03:30,063 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6ec8b84003eb45f7ba9b0998a58f6aa2 2023-09-28 09:03:30,064 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/hbase/acl/fc82fa152d0901260f95b1e6be2f3488/l/6ec8b84003eb45f7ba9b0998a58f6aa2, entries=7, sequenceid=18, filesize=5.2 K 2023-09-28 09:03:30,064 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for fc82fa152d0901260f95b1e6be2f3488 in 46ms, sequenceid=18, compaction requested=false 2023-09-28 09:03:30,066 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40045,1695891669000 already deleted, retry=false 2023-09-28 09:03:30,066 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40045,1695891669000 expired; onlineServers=2 2023-09-28 09:03:30,074 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/hbase/namespace/e02133285b6f183c0299d48a8ce537ee/info/f2772aa97249440481a55c4c45bb7d0d, entries=2, sequenceid=6, filesize=4.8 K 2023-09-28 09:03:30,075 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for e02133285b6f183c0299d48a8ce537ee in 57ms, sequenceid=6, compaction requested=false 2023-09-28 09:03:30,080 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/hbase/meta/1588230740/.tmp/rep_barrier/1d8492d269ad47c2a4f0cec85a4eeeb8 2023-09-28 09:03:30,080 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/hbase/acl/fc82fa152d0901260f95b1e6be2f3488/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-09-28 09:03:30,081 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 09:03:30,081 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1695891671834.fc82fa152d0901260f95b1e6be2f3488. 2023-09-28 09:03:30,081 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fc82fa152d0901260f95b1e6be2f3488: 2023-09-28 09:03:30,081 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1695891671834.fc82fa152d0901260f95b1e6be2f3488. 2023-09-28 09:03:30,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/hbase/namespace/e02133285b6f183c0299d48a8ce537ee/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-28 09:03:30,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 09:03:30,083 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695891671097.e02133285b6f183c0299d48a8ce537ee. 2023-09-28 09:03:30,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e02133285b6f183c0299d48a8ce537ee: 2023-09-28 09:03:30,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1695891671097.e02133285b6f183c0299d48a8ce537ee. 2023-09-28 09:03:30,085 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1d8492d269ad47c2a4f0cec85a4eeeb8 2023-09-28 09:03:30,096 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/hbase/meta/1588230740/.tmp/table/a162b9b515ad4f6ab58808f0600708ea 2023-09-28 09:03:30,100 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a162b9b515ad4f6ab58808f0600708ea 2023-09-28 09:03:30,100 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/hbase/meta/1588230740/.tmp/info/979233733f2b475ea376ee6c2481bbd8 as hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/hbase/meta/1588230740/info/979233733f2b475ea376ee6c2481bbd8 2023-09-28 09:03:30,104 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 979233733f2b475ea376ee6c2481bbd8 2023-09-28 09:03:30,104 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/hbase/meta/1588230740/info/979233733f2b475ea376ee6c2481bbd8, entries=48, sequenceid=131, filesize=10.3 K 2023-09-28 09:03:30,105 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/hbase/meta/1588230740/.tmp/rep_barrier/1d8492d269ad47c2a4f0cec85a4eeeb8 as hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/hbase/meta/1588230740/rep_barrier/1d8492d269ad47c2a4f0cec85a4eeeb8 2023-09-28 09:03:30,110 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1d8492d269ad47c2a4f0cec85a4eeeb8 2023-09-28 09:03:30,110 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/hbase/meta/1588230740/rep_barrier/1d8492d269ad47c2a4f0cec85a4eeeb8, entries=13, sequenceid=131, filesize=6.4 K 2023-09-28 09:03:30,110 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/hbase/meta/1588230740/.tmp/table/a162b9b515ad4f6ab58808f0600708ea as hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/hbase/meta/1588230740/table/a162b9b515ad4f6ab58808f0600708ea 2023-09-28 09:03:30,115 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a162b9b515ad4f6ab58808f0600708ea 2023-09-28 09:03:30,115 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/hbase/meta/1588230740/table/a162b9b515ad4f6ab58808f0600708ea, entries=24, sequenceid=131, filesize=6.9 K 2023-09-28 09:03:30,116 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 95ms, sequenceid=131, compaction requested=false 2023-09-28 09:03:30,127 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-09-28 09:03:30,127 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 09:03:30,127 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-28 09:03:30,128 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-28 09:03:30,128 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-28 09:03:30,128 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-09-28 09:03:30,159 INFO [RS:2;jenkins-hbase4:40045] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,40045,1695891669000; zookeeper connection closed. 2023-09-28 09:03:30,159 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-28 09:03:30,159 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40045-0x100f1c46ecd0003, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-28 09:03:30,159 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@178cad3] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@178cad3 2023-09-28 09:03:30,219 INFO [RS:0;jenkins-hbase4:39195] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39195,1695891668910; all regions closed. 2023-09-28 09:03:30,220 INFO [RS:1;jenkins-hbase4:40311] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,40311,1695891668959; all regions closed. 2023-09-28 09:03:30,227 DEBUG [RS:0;jenkins-hbase4:39195] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/oldWALs 2023-09-28 09:03:30,227 INFO [RS:0;jenkins-hbase4:39195] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39195%2C1695891668910:(num 1695891670673) 2023-09-28 09:03:30,227 DEBUG [RS:0;jenkins-hbase4:39195] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 09:03:30,227 INFO [RS:0;jenkins-hbase4:39195] regionserver.LeaseManager(133): Closed leases 2023-09-28 09:03:30,227 INFO [RS:0;jenkins-hbase4:39195] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-28 09:03:30,228 INFO [RS:0;jenkins-hbase4:39195] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-28 09:03:30,228 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-28 09:03:30,228 INFO [RS:0;jenkins-hbase4:39195] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-28 09:03:30,228 INFO [RS:0;jenkins-hbase4:39195] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-28 09:03:30,228 INFO [RS:0;jenkins-hbase4:39195] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39195 2023-09-28 09:03:30,229 DEBUG [RS:1;jenkins-hbase4:40311] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/oldWALs 2023-09-28 09:03:30,229 INFO [RS:1;jenkins-hbase4:40311] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40311%2C1695891668959.meta:.meta(num 1695891670808) 2023-09-28 09:03:30,231 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-28 09:03:30,231 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:03:30,232 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39195,1695891668910 2023-09-28 09:03:30,233 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39195,1695891668910] 2023-09-28 09:03:30,233 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39195,1695891668910; numProcessing=2 2023-09-28 09:03:30,234 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39195,1695891668910 already deleted, retry=false 2023-09-28 09:03:30,234 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39195,1695891668910 expired; onlineServers=1 2023-09-28 09:03:30,235 DEBUG [RS:1;jenkins-hbase4:40311] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/oldWALs 2023-09-28 09:03:30,235 INFO [RS:1;jenkins-hbase4:40311] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40311%2C1695891668959:(num 1695891670673) 2023-09-28 09:03:30,235 DEBUG [RS:1;jenkins-hbase4:40311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 09:03:30,235 INFO [RS:1;jenkins-hbase4:40311] regionserver.LeaseManager(133): Closed leases 2023-09-28 09:03:30,235 INFO [RS:1;jenkins-hbase4:40311] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-28 09:03:30,235 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-28 09:03:30,236 INFO [RS:1;jenkins-hbase4:40311] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40311 2023-09-28 09:03:30,238 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40311,1695891668959 2023-09-28 09:03:30,238 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-28 09:03:30,239 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40311,1695891668959] 2023-09-28 09:03:30,239 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40311,1695891668959; numProcessing=3 2023-09-28 09:03:30,241 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40311,1695891668959 already deleted, retry=false 2023-09-28 09:03:30,241 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40311,1695891668959 expired; onlineServers=0 2023-09-28 09:03:30,241 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,40293,1695891667656' ***** 2023-09-28 09:03:30,241 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-09-28 09:03:30,241 DEBUG [M:0;jenkins-hbase4:40293] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1dff2724, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-28 09:03:30,241 INFO [M:0;jenkins-hbase4:40293] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,40293,1695891667656 2023-09-28 09:03:30,241 INFO [M:0;jenkins-hbase4:40293] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,40293,1695891667656; all regions closed. 2023-09-28 09:03:30,241 DEBUG [M:0;jenkins-hbase4:40293] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 09:03:30,242 DEBUG [M:0;jenkins-hbase4:40293] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-09-28 09:03:30,242 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-09-28 09:03:30,242 DEBUG [M:0;jenkins-hbase4:40293] cleaner.HFileCleaner(317): Stopping file delete threads 2023-09-28 09:03:30,242 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695891670272] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695891670272,5,FailOnTimeoutGroup] 2023-09-28 09:03:30,242 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695891670272] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695891670272,5,FailOnTimeoutGroup] 2023-09-28 09:03:30,242 INFO [M:0;jenkins-hbase4:40293] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-09-28 09:03:30,242 INFO [M:0;jenkins-hbase4:40293] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-09-28 09:03:30,242 INFO [M:0;jenkins-hbase4:40293] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-09-28 09:03:30,242 DEBUG [M:0;jenkins-hbase4:40293] master.HMaster(1512): Stopping service threads 2023-09-28 09:03:30,242 INFO [M:0;jenkins-hbase4:40293] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-09-28 09:03:30,242 ERROR [M:0;jenkins-hbase4:40293] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-14,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-09-28 09:03:30,243 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-09-28 09:03:30,243 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-28 09:03:30,243 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-28 09:03:30,243 INFO [M:0;jenkins-hbase4:40293] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-09-28 09:03:30,243 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-09-28 09:03:30,243 DEBUG [M:0;jenkins-hbase4:40293] zookeeper.ZKUtil(398): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-09-28 09:03:30,243 WARN [M:0;jenkins-hbase4:40293] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-09-28 09:03:30,243 INFO [M:0;jenkins-hbase4:40293] assignment.AssignmentManager(315): Stopping assignment manager 2023-09-28 09:03:30,244 INFO [M:0;jenkins-hbase4:40293] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-09-28 09:03:30,244 DEBUG [M:0;jenkins-hbase4:40293] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-28 09:03:30,244 INFO [M:0;jenkins-hbase4:40293] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-28 09:03:30,244 DEBUG [M:0;jenkins-hbase4:40293] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-28 09:03:30,244 DEBUG [M:0;jenkins-hbase4:40293] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-28 09:03:30,244 DEBUG [M:0;jenkins-hbase4:40293] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-28 09:03:30,244 INFO [M:0;jenkins-hbase4:40293] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.69 KB heapSize=451.90 KB 2023-09-28 09:03:30,255 INFO [M:0;jenkins-hbase4:40293] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.69 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f6db7cabf42743f9b453c1e02fae1eb0 2023-09-28 09:03:30,259 INFO [M:0;jenkins-hbase4:40293] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f6db7cabf42743f9b453c1e02fae1eb0 2023-09-28 09:03:30,260 DEBUG [M:0;jenkins-hbase4:40293] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f6db7cabf42743f9b453c1e02fae1eb0 as hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f6db7cabf42743f9b453c1e02fae1eb0 2023-09-28 09:03:30,263 INFO [M:0;jenkins-hbase4:40293] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f6db7cabf42743f9b453c1e02fae1eb0 2023-09-28 09:03:30,263 INFO [M:0;jenkins-hbase4:40293] regionserver.HStore(1080): Added hdfs://localhost:39781/user/jenkins/test-data/e63d2b66-7b71-b120-e46f-94486957c0ba/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f6db7cabf42743f9b453c1e02fae1eb0, entries=119, sequenceid=899, filesize=28.6 K 2023-09-28 09:03:30,264 INFO [M:0;jenkins-hbase4:40293] regionserver.HRegion(2948): Finished flush of dataSize ~375.69 KB/384702, heapSize ~451.88 KB/462728, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 20ms, sequenceid=899, compaction requested=false 2023-09-28 09:03:30,265 INFO [M:0;jenkins-hbase4:40293] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-28 09:03:30,265 DEBUG [M:0;jenkins-hbase4:40293] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-28 09:03:30,268 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-28 09:03:30,268 INFO [M:0;jenkins-hbase4:40293] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-09-28 09:03:30,269 INFO [M:0;jenkins-hbase4:40293] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40293 2023-09-28 09:03:30,271 DEBUG [M:0;jenkins-hbase4:40293] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,40293,1695891667656 already deleted, retry=false 2023-09-28 09:03:30,334 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-28 09:03:30,334 INFO [RS:0;jenkins-hbase4:39195] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39195,1695891668910; zookeeper connection closed. 2023-09-28 09:03:30,334 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:39195-0x100f1c46ecd0001, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-28 09:03:30,334 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@56ac3799] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@56ac3799 2023-09-28 09:03:30,434 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-28 09:03:30,434 INFO [M:0;jenkins-hbase4:40293] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,40293,1695891667656; zookeeper connection closed. 2023-09-28 09:03:30,434 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): master:40293-0x100f1c46ecd0000, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-28 09:03:30,534 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-28 09:03:30,534 DEBUG [Listener at localhost/34939-EventThread] zookeeper.ZKWatcher(600): regionserver:40311-0x100f1c46ecd0002, quorum=127.0.0.1:61959, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-28 09:03:30,534 INFO [RS:1;jenkins-hbase4:40311] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,40311,1695891668959; zookeeper connection closed. 2023-09-28 09:03:30,535 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@66a4b301] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@66a4b301 2023-09-28 09:03:30,535 INFO [Listener at jenkins-hbase4.apache.org/39071] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-09-28 09:03:30,535 WARN [Listener at jenkins-hbase4.apache.org/39071] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-28 09:03:30,538 INFO [Listener at jenkins-hbase4.apache.org/39071] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-28 09:03:30,642 WARN [BP-868017143-172.31.14.131-1695891663860 heartbeating to localhost/127.0.0.1:39781] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-28 09:03:30,642 WARN [BP-868017143-172.31.14.131-1695891663860 heartbeating to localhost/127.0.0.1:39781] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-868017143-172.31.14.131-1695891663860 (Datanode Uuid 3dc0a062-a92e-4f48-872a-9e1d8a22ee36) service to localhost/127.0.0.1:39781 2023-09-28 09:03:30,644 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/cluster_cdbda8d1-4c7c-df9a-692b-a4fb20b2dac6/dfs/data/data5/current/BP-868017143-172.31.14.131-1695891663860] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-28 09:03:30,644 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/cluster_cdbda8d1-4c7c-df9a-692b-a4fb20b2dac6/dfs/data/data6/current/BP-868017143-172.31.14.131-1695891663860] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-28 09:03:30,646 WARN [Listener at jenkins-hbase4.apache.org/39071] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-28 09:03:30,648 INFO [Listener at jenkins-hbase4.apache.org/39071] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-28 09:03:30,751 WARN [BP-868017143-172.31.14.131-1695891663860 heartbeating to localhost/127.0.0.1:39781] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-28 09:03:30,751 WARN [BP-868017143-172.31.14.131-1695891663860 heartbeating to localhost/127.0.0.1:39781] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-868017143-172.31.14.131-1695891663860 (Datanode Uuid 0d41f323-2d3f-44f7-ade8-9bb601c52e9b) service to localhost/127.0.0.1:39781 2023-09-28 09:03:30,752 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/cluster_cdbda8d1-4c7c-df9a-692b-a4fb20b2dac6/dfs/data/data3/current/BP-868017143-172.31.14.131-1695891663860] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-28 09:03:30,752 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/cluster_cdbda8d1-4c7c-df9a-692b-a4fb20b2dac6/dfs/data/data4/current/BP-868017143-172.31.14.131-1695891663860] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-28 09:03:30,753 WARN [Listener at jenkins-hbase4.apache.org/39071] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-28 09:03:30,755 INFO [Listener at jenkins-hbase4.apache.org/39071] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-28 09:03:30,858 WARN [BP-868017143-172.31.14.131-1695891663860 heartbeating to localhost/127.0.0.1:39781] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-28 09:03:30,858 WARN [BP-868017143-172.31.14.131-1695891663860 heartbeating to localhost/127.0.0.1:39781] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-868017143-172.31.14.131-1695891663860 (Datanode Uuid 3a604e24-442d-4d02-a9ee-700283cd500a) service to localhost/127.0.0.1:39781 2023-09-28 09:03:30,859 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/cluster_cdbda8d1-4c7c-df9a-692b-a4fb20b2dac6/dfs/data/data1/current/BP-868017143-172.31.14.131-1695891663860] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-28 09:03:30,859 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c37ef2ce-e977-1af6-2b40-cd8fc875d1db/cluster_cdbda8d1-4c7c-df9a-692b-a4fb20b2dac6/dfs/data/data2/current/BP-868017143-172.31.14.131-1695891663860] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-28 09:03:30,880 INFO [Listener at jenkins-hbase4.apache.org/39071] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-28 09:03:31,005 INFO [Listener at jenkins-hbase4.apache.org/39071] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-09-28 09:03:31,089 INFO [Listener at jenkins-hbase4.apache.org/39071] hbase.HBaseTestingUtility(1293): Minicluster is down