2023-09-14 07:00:50,264 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-09-14 07:00:50,491 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62 2023-09-14 07:00:50,491 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-09-14 07:00:50,492 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-09-14 07:00:50,532 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-09-14 07:00:50,779 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-09-14 07:00:50,779 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/cluster_e41a8b39-3adf-15a8-f202-16f92e78dec5, deleteOnExit=true 2023-09-14 07:00:50,779 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-09-14 07:00:50,780 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/test.cache.data in system properties and HBase conf 2023-09-14 07:00:50,780 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/hadoop.tmp.dir in system properties and HBase conf 2023-09-14 07:00:50,780 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/hadoop.log.dir in system properties and HBase conf 2023-09-14 07:00:50,781 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-14 07:00:50,781 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-14 07:00:50,781 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-14 07:00:51,125 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-09-14 07:00:51,132 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-14 07:00:51,133 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-14 07:00:51,133 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-14 07:00:51,134 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-14 07:00:51,134 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-14 07:00:51,134 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-14 07:00:51,135 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-14 07:00:51,135 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-14 07:00:51,136 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-14 07:00:51,136 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/nfs.dump.dir in system properties and HBase conf 2023-09-14 07:00:51,137 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/java.io.tmpdir in system properties and HBase conf 2023-09-14 07:00:51,137 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-14 07:00:51,137 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-14 07:00:51,138 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-09-14 07:00:51,643 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-14 07:00:51,648 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-14 07:00:51,954 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-09-14 07:00:52,116 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-09-14 07:00:52,130 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-14 07:00:52,169 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-09-14 07:00:52,204 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/java.io.tmpdir/Jetty_localhost_33263_hdfs____t9dlfd/webapp 2023-09-14 07:00:52,334 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33263 2023-09-14 07:00:52,374 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-14 07:00:52,374 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-14 07:00:52,861 WARN [Listener at localhost/44283] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-14 07:00:52,953 WARN [Listener at localhost/44283] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-14 07:00:52,973 WARN [Listener at localhost/44283] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-14 07:00:52,981 INFO [Listener at localhost/44283] log.Slf4jLog(67): jetty-6.1.26 2023-09-14 07:00:52,987 INFO [Listener at localhost/44283] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/java.io.tmpdir/Jetty_localhost_33243_datanode____.wpi11k/webapp 2023-09-14 07:00:53,090 INFO [Listener at localhost/44283] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33243 2023-09-14 07:00:53,543 WARN [Listener at localhost/35865] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-14 07:00:53,556 WARN [Listener at localhost/35865] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-14 07:00:53,559 WARN [Listener at localhost/35865] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-14 07:00:53,562 INFO [Listener at localhost/35865] log.Slf4jLog(67): jetty-6.1.26 2023-09-14 07:00:53,570 INFO [Listener at localhost/35865] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/java.io.tmpdir/Jetty_localhost_41941_datanode____.max9s0/webapp 2023-09-14 07:00:53,667 INFO [Listener at localhost/35865] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41941 2023-09-14 07:00:53,680 WARN [Listener at localhost/39677] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-14 07:00:53,699 WARN [Listener at localhost/39677] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-14 07:00:53,702 WARN [Listener at localhost/39677] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-14 07:00:53,703 INFO [Listener at localhost/39677] log.Slf4jLog(67): jetty-6.1.26 2023-09-14 07:00:53,711 INFO [Listener at localhost/39677] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/java.io.tmpdir/Jetty_localhost_42631_datanode____.q5g283/webapp 2023-09-14 07:00:53,844 INFO [Listener at localhost/39677] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42631 2023-09-14 07:00:53,857 WARN [Listener at localhost/35097] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-14 07:00:54,089 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc4f3b030a930d8a: Processing first storage report for DS-2e2b40aa-573e-49ed-9327-bf5c6ea00025 from datanode e52718cd-89c8-4f02-abb7-65322675f931 2023-09-14 07:00:54,091 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc4f3b030a930d8a: from storage DS-2e2b40aa-573e-49ed-9327-bf5c6ea00025 node DatanodeRegistration(127.0.0.1:45741, datanodeUuid=e52718cd-89c8-4f02-abb7-65322675f931, infoPort=45335, infoSecurePort=0, ipcPort=35097, storageInfo=lv=-57;cid=testClusterID;nsid=14519244;c=1694674851730), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-09-14 07:00:54,091 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2fbc06520f8903da: Processing first storage report for DS-d15af083-fca4-4977-b008-202db79f5b06 from datanode 4a706415-c677-4b58-a286-735f266e4884 2023-09-14 07:00:54,091 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2fbc06520f8903da: from storage DS-d15af083-fca4-4977-b008-202db79f5b06 node DatanodeRegistration(127.0.0.1:34299, datanodeUuid=4a706415-c677-4b58-a286-735f266e4884, infoPort=41273, infoSecurePort=0, ipcPort=39677, storageInfo=lv=-57;cid=testClusterID;nsid=14519244;c=1694674851730), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-14 07:00:54,091 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x392b60adb359bb3b: Processing first storage report for DS-9a8f7d0c-bb3e-4f4c-bb7c-c31ddcb30ee9 from datanode 8278a81d-35fb-4209-8cf7-8541ee337911 2023-09-14 07:00:54,091 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x392b60adb359bb3b: from storage DS-9a8f7d0c-bb3e-4f4c-bb7c-c31ddcb30ee9 node DatanodeRegistration(127.0.0.1:38597, datanodeUuid=8278a81d-35fb-4209-8cf7-8541ee337911, infoPort=45727, infoSecurePort=0, ipcPort=35865, storageInfo=lv=-57;cid=testClusterID;nsid=14519244;c=1694674851730), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-09-14 07:00:54,091 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc4f3b030a930d8a: Processing first storage report for DS-e9837002-d24d-4cdb-9d8c-16343835a164 from datanode e52718cd-89c8-4f02-abb7-65322675f931 2023-09-14 07:00:54,091 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc4f3b030a930d8a: from storage DS-e9837002-d24d-4cdb-9d8c-16343835a164 node DatanodeRegistration(127.0.0.1:45741, datanodeUuid=e52718cd-89c8-4f02-abb7-65322675f931, infoPort=45335, infoSecurePort=0, ipcPort=35097, storageInfo=lv=-57;cid=testClusterID;nsid=14519244;c=1694674851730), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-14 07:00:54,092 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2fbc06520f8903da: Processing first storage report for DS-751cce12-ae10-41cf-8eb4-459539fe240d from datanode 4a706415-c677-4b58-a286-735f266e4884 2023-09-14 07:00:54,092 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2fbc06520f8903da: from storage DS-751cce12-ae10-41cf-8eb4-459539fe240d node DatanodeRegistration(127.0.0.1:34299, datanodeUuid=4a706415-c677-4b58-a286-735f266e4884, infoPort=41273, infoSecurePort=0, ipcPort=39677, storageInfo=lv=-57;cid=testClusterID;nsid=14519244;c=1694674851730), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-14 07:00:54,092 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x392b60adb359bb3b: Processing first storage report for DS-9d472c6f-bdd1-445c-a367-82d19d42f264 from datanode 8278a81d-35fb-4209-8cf7-8541ee337911 2023-09-14 07:00:54,092 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x392b60adb359bb3b: from storage DS-9d472c6f-bdd1-445c-a367-82d19d42f264 node DatanodeRegistration(127.0.0.1:38597, datanodeUuid=8278a81d-35fb-4209-8cf7-8541ee337911, infoPort=45727, infoSecurePort=0, ipcPort=35865, storageInfo=lv=-57;cid=testClusterID;nsid=14519244;c=1694674851730), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-14 07:00:54,400 DEBUG [Listener at localhost/35097] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62 2023-09-14 07:00:54,494 INFO [Listener at localhost/35097] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/cluster_e41a8b39-3adf-15a8-f202-16f92e78dec5/zookeeper_0, clientPort=52295, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/cluster_e41a8b39-3adf-15a8-f202-16f92e78dec5/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/cluster_e41a8b39-3adf-15a8-f202-16f92e78dec5/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-09-14 07:00:54,518 INFO [Listener at localhost/35097] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=52295 2023-09-14 07:00:54,530 INFO [Listener at localhost/35097] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-14 07:00:54,533 INFO [Listener at localhost/35097] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-14 07:00:55,225 INFO [Listener at localhost/35097] util.FSUtils(471): Created version file at hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04 with version=8 2023-09-14 07:00:55,225 INFO [Listener at localhost/35097] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/hbase-staging 2023-09-14 07:00:55,621 INFO [Listener at localhost/35097] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-09-14 07:00:56,077 INFO [Listener at localhost/35097] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-09-14 07:00:56,110 INFO [Listener at localhost/35097] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-14 07:00:56,111 INFO [Listener at localhost/35097] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-14 07:00:56,111 INFO [Listener at localhost/35097] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-14 07:00:56,111 INFO [Listener at localhost/35097] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-14 07:00:56,111 INFO [Listener at localhost/35097] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-14 07:00:56,252 INFO [Listener at localhost/35097] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-09-14 07:00:56,325 DEBUG [Listener at localhost/35097] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-09-14 07:00:56,419 INFO [Listener at localhost/35097] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33055 2023-09-14 07:00:56,432 INFO [Listener at localhost/35097] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-14 07:00:56,434 INFO [Listener at localhost/35097] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-14 07:00:56,457 INFO [Listener at localhost/35097] zookeeper.RecoverableZooKeeper(93): Process identifier=master:33055 connecting to ZooKeeper ensemble=127.0.0.1:52295 2023-09-14 07:00:56,512 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:330550x0, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-14 07:00:56,516 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:33055-0x100a93d59ec0000 connected 2023-09-14 07:00:56,550 DEBUG [Listener at localhost/35097] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-14 07:00:56,551 DEBUG [Listener at localhost/35097] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-14 07:00:56,564 DEBUG [Listener at localhost/35097] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-14 07:00:56,572 DEBUG [Listener at localhost/35097] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33055 2023-09-14 07:00:56,572 DEBUG [Listener at localhost/35097] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33055 2023-09-14 07:00:56,573 DEBUG [Listener at localhost/35097] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33055 2023-09-14 07:00:56,575 DEBUG [Listener at localhost/35097] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33055 2023-09-14 07:00:56,575 DEBUG [Listener at localhost/35097] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33055 2023-09-14 07:00:56,582 INFO [Listener at localhost/35097] master.HMaster(444): hbase.rootdir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04, hbase.cluster.distributed=false 2023-09-14 07:00:56,650 INFO [Listener at localhost/35097] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-14 07:00:56,650 INFO [Listener at localhost/35097] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-14 07:00:56,650 INFO [Listener at localhost/35097] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-14 07:00:56,651 INFO [Listener at localhost/35097] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-14 07:00:56,651 INFO [Listener at localhost/35097] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-14 07:00:56,651 INFO [Listener at localhost/35097] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-14 07:00:56,656 INFO [Listener at localhost/35097] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-14 07:00:56,659 INFO [Listener at localhost/35097] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35941 2023-09-14 07:00:56,662 INFO [Listener at localhost/35097] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-14 07:00:56,668 INFO [Listener at localhost/35097] mob.MobFileCache(124): MobFileCache disabled 2023-09-14 07:00:56,669 INFO [Listener at localhost/35097] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-14 07:00:56,671 INFO [Listener at localhost/35097] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-14 07:00:56,674 INFO [Listener at localhost/35097] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35941 connecting to ZooKeeper ensemble=127.0.0.1:52295 2023-09-14 07:00:56,677 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:359410x0, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-14 07:00:56,678 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:35941-0x100a93d59ec0001 connected 2023-09-14 07:00:56,679 DEBUG [Listener at localhost/35097] zookeeper.ZKUtil(164): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-14 07:00:56,680 DEBUG [Listener at localhost/35097] zookeeper.ZKUtil(164): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-14 07:00:56,681 DEBUG [Listener at localhost/35097] zookeeper.ZKUtil(164): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-14 07:00:56,682 DEBUG [Listener at localhost/35097] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35941 2023-09-14 07:00:56,682 DEBUG [Listener at localhost/35097] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35941 2023-09-14 07:00:56,682 DEBUG [Listener at localhost/35097] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35941 2023-09-14 07:00:56,683 DEBUG [Listener at localhost/35097] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35941 2023-09-14 07:00:56,683 DEBUG [Listener at localhost/35097] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35941 2023-09-14 07:00:56,696 INFO [Listener at localhost/35097] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-14 07:00:56,696 INFO [Listener at localhost/35097] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-14 07:00:56,697 INFO [Listener at localhost/35097] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-14 07:00:56,697 INFO [Listener at localhost/35097] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-14 07:00:56,698 INFO [Listener at localhost/35097] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-14 07:00:56,698 INFO [Listener at localhost/35097] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-14 07:00:56,698 INFO [Listener at localhost/35097] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-14 07:00:56,700 INFO [Listener at localhost/35097] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37703 2023-09-14 07:00:56,700 INFO [Listener at localhost/35097] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-14 07:00:56,701 INFO [Listener at localhost/35097] mob.MobFileCache(124): MobFileCache disabled 2023-09-14 07:00:56,702 INFO [Listener at localhost/35097] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-14 07:00:56,705 INFO [Listener at localhost/35097] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-14 07:00:56,708 INFO [Listener at localhost/35097] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37703 connecting to ZooKeeper ensemble=127.0.0.1:52295 2023-09-14 07:00:56,716 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:377030x0, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-14 07:00:56,717 DEBUG [Listener at localhost/35097] zookeeper.ZKUtil(164): regionserver:377030x0, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-14 07:00:56,718 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:37703-0x100a93d59ec0002 connected 2023-09-14 07:00:56,718 DEBUG [Listener at localhost/35097] zookeeper.ZKUtil(164): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-14 07:00:56,719 DEBUG [Listener at localhost/35097] zookeeper.ZKUtil(164): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-14 07:00:56,720 DEBUG [Listener at localhost/35097] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37703 2023-09-14 07:00:56,722 DEBUG [Listener at localhost/35097] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37703 2023-09-14 07:00:56,722 DEBUG [Listener at localhost/35097] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37703 2023-09-14 07:00:56,723 DEBUG [Listener at localhost/35097] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37703 2023-09-14 07:00:56,723 DEBUG [Listener at localhost/35097] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37703 2023-09-14 07:00:56,736 INFO [Listener at localhost/35097] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-14 07:00:56,736 INFO [Listener at localhost/35097] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-14 07:00:56,736 INFO [Listener at localhost/35097] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-14 07:00:56,736 INFO [Listener at localhost/35097] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-14 07:00:56,737 INFO [Listener at localhost/35097] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-14 07:00:56,737 INFO [Listener at localhost/35097] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-14 07:00:56,737 INFO [Listener at localhost/35097] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-14 07:00:56,739 INFO [Listener at localhost/35097] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41005 2023-09-14 07:00:56,739 INFO [Listener at localhost/35097] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-14 07:00:56,742 INFO [Listener at localhost/35097] mob.MobFileCache(124): MobFileCache disabled 2023-09-14 07:00:56,744 INFO [Listener at localhost/35097] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-14 07:00:56,746 INFO [Listener at localhost/35097] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-14 07:00:56,748 INFO [Listener at localhost/35097] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41005 connecting to ZooKeeper ensemble=127.0.0.1:52295 2023-09-14 07:00:56,756 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:410050x0, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-14 07:00:56,757 DEBUG [Listener at localhost/35097] zookeeper.ZKUtil(164): regionserver:410050x0, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-14 07:00:56,757 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:41005-0x100a93d59ec0003 connected 2023-09-14 07:00:56,758 DEBUG [Listener at localhost/35097] zookeeper.ZKUtil(164): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-14 07:00:56,759 DEBUG [Listener at localhost/35097] zookeeper.ZKUtil(164): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-14 07:00:56,759 DEBUG [Listener at localhost/35097] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41005 2023-09-14 07:00:56,760 DEBUG [Listener at localhost/35097] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41005 2023-09-14 07:00:56,765 DEBUG [Listener at localhost/35097] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41005 2023-09-14 07:00:56,765 DEBUG [Listener at localhost/35097] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41005 2023-09-14 07:00:56,765 DEBUG [Listener at localhost/35097] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41005 2023-09-14 07:00:56,767 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,33055,1694674855392 2023-09-14 07:00:56,777 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-14 07:00:56,779 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,33055,1694674855392 2023-09-14 07:00:56,799 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-14 07:00:56,799 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-14 07:00:56,799 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-14 07:00:56,799 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-14 07:00:56,801 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-14 07:00:56,801 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-14 07:00:56,803 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,33055,1694674855392 from backup master directory 2023-09-14 07:00:56,804 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-14 07:00:56,809 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,33055,1694674855392 2023-09-14 07:00:56,809 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-14 07:00:56,810 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-14 07:00:56,810 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,33055,1694674855392 2023-09-14 07:00:56,814 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-09-14 07:00:56,815 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-09-14 07:00:56,915 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/hbase.id with ID: 489bd41d-f76e-42c1-bb8a-32ed95e3c9fd 2023-09-14 07:00:56,957 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-14 07:00:56,973 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-14 07:00:57,026 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x54473360 to 127.0.0.1:52295 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 07:00:57,062 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@48370662, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 07:00:57,088 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-14 07:00:57,090 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-09-14 07:00:57,107 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-09-14 07:00:57,107 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-09-14 07:00:57,109 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-14 07:00:57,114 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-14 07:00:57,115 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-14 07:00:57,151 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/MasterData/data/master/store-tmp 2023-09-14 07:00:57,194 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 07:00:57,195 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-14 07:00:57,195 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-14 07:00:57,195 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-14 07:00:57,195 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-14 07:00:57,195 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-14 07:00:57,195 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-14 07:00:57,195 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-14 07:00:57,197 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/MasterData/WALs/jenkins-hbase4.apache.org,33055,1694674855392 2023-09-14 07:00:57,219 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33055%2C1694674855392, suffix=, logDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/MasterData/WALs/jenkins-hbase4.apache.org,33055,1694674855392, archiveDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/MasterData/oldWALs, maxLogs=10 2023-09-14 07:00:57,282 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45741,DS-2e2b40aa-573e-49ed-9327-bf5c6ea00025,DISK] 2023-09-14 07:00:57,282 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38597,DS-9a8f7d0c-bb3e-4f4c-bb7c-c31ddcb30ee9,DISK] 2023-09-14 07:00:57,282 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34299,DS-d15af083-fca4-4977-b008-202db79f5b06,DISK] 2023-09-14 07:00:57,290 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-09-14 07:00:57,356 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/MasterData/WALs/jenkins-hbase4.apache.org,33055,1694674855392/jenkins-hbase4.apache.org%2C33055%2C1694674855392.1694674857230 2023-09-14 07:00:57,357 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38597,DS-9a8f7d0c-bb3e-4f4c-bb7c-c31ddcb30ee9,DISK], DatanodeInfoWithStorage[127.0.0.1:34299,DS-d15af083-fca4-4977-b008-202db79f5b06,DISK], DatanodeInfoWithStorage[127.0.0.1:45741,DS-2e2b40aa-573e-49ed-9327-bf5c6ea00025,DISK]] 2023-09-14 07:00:57,357 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-09-14 07:00:57,358 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 07:00:57,361 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-09-14 07:00:57,362 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-09-14 07:00:57,426 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-09-14 07:00:57,434 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-09-14 07:00:57,462 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-09-14 07:00:57,474 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-14 07:00:57,480 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-14 07:00:57,482 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-14 07:00:57,497 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-09-14 07:00:57,501 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-14 07:00:57,502 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64831255, jitterRate=-0.033939018845558167}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-14 07:00:57,502 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-14 07:00:57,503 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-09-14 07:00:57,536 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-09-14 07:00:57,537 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-09-14 07:00:57,541 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-09-14 07:00:57,543 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-09-14 07:00:57,579 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 36 msec 2023-09-14 07:00:57,579 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-09-14 07:00:57,609 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-09-14 07:00:57,614 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-09-14 07:00:57,646 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-09-14 07:00:57,653 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-09-14 07:00:57,655 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-09-14 07:00:57,661 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-09-14 07:00:57,666 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-09-14 07:00:57,668 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-14 07:00:57,670 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-09-14 07:00:57,670 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-09-14 07:00:57,684 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-09-14 07:00:57,689 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-14 07:00:57,689 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-14 07:00:57,689 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-14 07:00:57,689 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-14 07:00:57,689 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-14 07:00:57,690 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,33055,1694674855392, sessionid=0x100a93d59ec0000, setting cluster-up flag (Was=false) 2023-09-14 07:00:57,711 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-14 07:00:57,717 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-09-14 07:00:57,719 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33055,1694674855392 2023-09-14 07:00:57,725 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-14 07:00:57,730 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-09-14 07:00:57,732 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33055,1694674855392 2023-09-14 07:00:57,735 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/.tmp 2023-09-14 07:00:57,771 INFO [RS:0;jenkins-hbase4:35941] regionserver.HRegionServer(951): ClusterId : 489bd41d-f76e-42c1-bb8a-32ed95e3c9fd 2023-09-14 07:00:57,771 INFO [RS:2;jenkins-hbase4:41005] regionserver.HRegionServer(951): ClusterId : 489bd41d-f76e-42c1-bb8a-32ed95e3c9fd 2023-09-14 07:00:57,771 INFO [RS:1;jenkins-hbase4:37703] regionserver.HRegionServer(951): ClusterId : 489bd41d-f76e-42c1-bb8a-32ed95e3c9fd 2023-09-14 07:00:57,777 DEBUG [RS:0;jenkins-hbase4:35941] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-14 07:00:57,777 DEBUG [RS:2;jenkins-hbase4:41005] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-14 07:00:57,777 DEBUG [RS:1;jenkins-hbase4:37703] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-14 07:00:57,785 DEBUG [RS:2;jenkins-hbase4:41005] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-14 07:00:57,785 DEBUG [RS:1;jenkins-hbase4:37703] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-14 07:00:57,786 DEBUG [RS:1;jenkins-hbase4:37703] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-14 07:00:57,785 DEBUG [RS:0;jenkins-hbase4:35941] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-14 07:00:57,785 DEBUG [RS:2;jenkins-hbase4:41005] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-14 07:00:57,786 DEBUG [RS:0;jenkins-hbase4:35941] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-14 07:00:57,790 DEBUG [RS:1;jenkins-hbase4:37703] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-14 07:00:57,790 DEBUG [RS:0;jenkins-hbase4:35941] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-14 07:00:57,791 DEBUG [RS:2;jenkins-hbase4:41005] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-14 07:00:57,792 DEBUG [RS:1;jenkins-hbase4:37703] zookeeper.ReadOnlyZKClient(139): Connect 0x67ae90ba to 127.0.0.1:52295 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 07:00:57,799 DEBUG [RS:2;jenkins-hbase4:41005] zookeeper.ReadOnlyZKClient(139): Connect 0x6d3ccca5 to 127.0.0.1:52295 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 07:00:57,799 DEBUG [RS:0;jenkins-hbase4:35941] zookeeper.ReadOnlyZKClient(139): Connect 0x6daea4b0 to 127.0.0.1:52295 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 07:00:57,808 DEBUG [RS:1;jenkins-hbase4:37703] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6969723f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 07:00:57,810 DEBUG [RS:1;jenkins-hbase4:37703] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d56fbca, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-14 07:00:57,812 DEBUG [RS:0;jenkins-hbase4:35941] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@63695775, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 07:00:57,813 DEBUG [RS:0;jenkins-hbase4:35941] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6756cfc0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-14 07:00:57,813 DEBUG [RS:2;jenkins-hbase4:41005] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@63fb3f72, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 07:00:57,813 DEBUG [RS:2;jenkins-hbase4:41005] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@67c4a7d5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-14 07:00:57,834 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-09-14 07:00:57,837 DEBUG [RS:1;jenkins-hbase4:37703] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:37703 2023-09-14 07:00:57,840 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-14 07:00:57,840 DEBUG [RS:2;jenkins-hbase4:41005] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:41005 2023-09-14 07:00:57,840 DEBUG [RS:0;jenkins-hbase4:35941] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:35941 2023-09-14 07:00:57,841 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-09-14 07:00:57,843 INFO [RS:1;jenkins-hbase4:37703] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-14 07:00:57,843 INFO [RS:0;jenkins-hbase4:35941] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-14 07:00:57,844 INFO [RS:1;jenkins-hbase4:37703] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-14 07:00:57,843 INFO [RS:2;jenkins-hbase4:41005] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-14 07:00:57,844 INFO [RS:0;jenkins-hbase4:35941] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-14 07:00:57,844 INFO [RS:2;jenkins-hbase4:41005] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-14 07:00:57,844 DEBUG [RS:1;jenkins-hbase4:37703] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-14 07:00:57,844 DEBUG [RS:2;jenkins-hbase4:41005] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-14 07:00:57,844 DEBUG [RS:0;jenkins-hbase4:35941] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-14 07:00:57,845 INFO [RS:1;jenkins-hbase4:37703] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-14 07:00:57,845 DEBUG [RS:1;jenkins-hbase4:37703] regionserver.HRegionServer(1022): About to register with Master. 2023-09-14 07:00:57,845 INFO [RS:0;jenkins-hbase4:35941] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-14 07:00:57,845 INFO [RS:2;jenkins-hbase4:41005] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-14 07:00:57,846 DEBUG [RS:2;jenkins-hbase4:41005] regionserver.HRegionServer(1022): About to register with Master. 2023-09-14 07:00:57,846 DEBUG [RS:0;jenkins-hbase4:35941] regionserver.HRegionServer(1022): About to register with Master. 2023-09-14 07:00:57,848 INFO [RS:2;jenkins-hbase4:41005] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33055,1694674855392 with isa=jenkins-hbase4.apache.org/172.31.14.131:41005, startcode=1694674856735 2023-09-14 07:00:57,848 INFO [RS:1;jenkins-hbase4:37703] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33055,1694674855392 with isa=jenkins-hbase4.apache.org/172.31.14.131:37703, startcode=1694674856695 2023-09-14 07:00:57,848 INFO [RS:0;jenkins-hbase4:35941] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33055,1694674855392 with isa=jenkins-hbase4.apache.org/172.31.14.131:35941, startcode=1694674856649 2023-09-14 07:00:57,867 DEBUG [RS:0;jenkins-hbase4:35941] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-14 07:00:57,867 DEBUG [RS:1;jenkins-hbase4:37703] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-14 07:00:57,867 DEBUG [RS:2;jenkins-hbase4:41005] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-14 07:00:57,949 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43267, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-09-14 07:00:57,949 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44321, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-09-14 07:00:57,949 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60181, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-09-14 07:00:57,963 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33055] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-14 07:00:57,970 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-09-14 07:00:57,971 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33055] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-14 07:00:57,974 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33055] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-14 07:00:57,988 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-14 07:00:57,988 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-14 07:00:57,988 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-14 07:00:57,988 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-14 07:00:57,989 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-09-14 07:00:57,989 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 07:00:57,989 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-14 07:00:57,989 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 07:00:57,990 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1694674887990 2023-09-14 07:00:57,994 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-09-14 07:00:57,997 DEBUG [RS:1;jenkins-hbase4:37703] regionserver.HRegionServer(2830): Master is not running yet 2023-09-14 07:00:57,997 DEBUG [RS:2;jenkins-hbase4:41005] regionserver.HRegionServer(2830): Master is not running yet 2023-09-14 07:00:57,997 DEBUG [RS:0;jenkins-hbase4:35941] regionserver.HRegionServer(2830): Master is not running yet 2023-09-14 07:00:57,997 WARN [RS:2;jenkins-hbase4:41005] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-14 07:00:57,997 WARN [RS:1;jenkins-hbase4:37703] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-14 07:00:57,997 WARN [RS:0;jenkins-hbase4:35941] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-14 07:00:57,999 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-09-14 07:00:57,999 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-09-14 07:00:58,005 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-14 07:00:58,007 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-09-14 07:00:58,016 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-09-14 07:00:58,017 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-09-14 07:00:58,018 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-09-14 07:00:58,018 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-09-14 07:00:58,020 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-14 07:00:58,022 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-09-14 07:00:58,025 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-09-14 07:00:58,025 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-09-14 07:00:58,029 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-09-14 07:00:58,029 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-09-14 07:00:58,032 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1694674858032,5,FailOnTimeoutGroup] 2023-09-14 07:00:58,032 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1694674858032,5,FailOnTimeoutGroup] 2023-09-14 07:00:58,032 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-14 07:00:58,032 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-09-14 07:00:58,035 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-09-14 07:00:58,035 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-09-14 07:00:58,052 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-14 07:00:58,054 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-14 07:00:58,054 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04 2023-09-14 07:00:58,076 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 07:00:58,079 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-14 07:00:58,081 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/hbase/meta/1588230740/info 2023-09-14 07:00:58,082 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-14 07:00:58,083 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-14 07:00:58,083 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-14 07:00:58,086 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/hbase/meta/1588230740/rep_barrier 2023-09-14 07:00:58,086 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-14 07:00:58,087 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-14 07:00:58,087 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-14 07:00:58,089 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/hbase/meta/1588230740/table 2023-09-14 07:00:58,090 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-14 07:00:58,091 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-14 07:00:58,092 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/hbase/meta/1588230740 2023-09-14 07:00:58,093 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/hbase/meta/1588230740 2023-09-14 07:00:58,097 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-14 07:00:58,098 INFO [RS:2;jenkins-hbase4:41005] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33055,1694674855392 with isa=jenkins-hbase4.apache.org/172.31.14.131:41005, startcode=1694674856735 2023-09-14 07:00:58,098 INFO [RS:0;jenkins-hbase4:35941] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33055,1694674855392 with isa=jenkins-hbase4.apache.org/172.31.14.131:35941, startcode=1694674856649 2023-09-14 07:00:58,098 INFO [RS:1;jenkins-hbase4:37703] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33055,1694674855392 with isa=jenkins-hbase4.apache.org/172.31.14.131:37703, startcode=1694674856695 2023-09-14 07:00:58,101 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-14 07:00:58,105 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33055] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:00:58,107 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-14 07:00:58,108 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65608301, jitterRate=-0.02236013114452362}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-14 07:00:58,108 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-14 07:00:58,108 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-14 07:00:58,108 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-14 07:00:58,108 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-14 07:00:58,108 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-14 07:00:58,108 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-14 07:00:58,110 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-14 07:00:58,110 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-14 07:00:58,114 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33055] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:00:58,116 DEBUG [RS:1;jenkins-hbase4:37703] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04 2023-09-14 07:00:58,116 DEBUG [RS:1;jenkins-hbase4:37703] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:44283 2023-09-14 07:00:58,116 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33055] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:00:58,116 DEBUG [RS:1;jenkins-hbase4:37703] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-14 07:00:58,117 DEBUG [RS:0;jenkins-hbase4:35941] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04 2023-09-14 07:00:58,117 DEBUG [RS:0;jenkins-hbase4:35941] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:44283 2023-09-14 07:00:58,117 DEBUG [RS:0;jenkins-hbase4:35941] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-14 07:00:58,119 DEBUG [RS:2;jenkins-hbase4:41005] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04 2023-09-14 07:00:58,119 DEBUG [RS:2;jenkins-hbase4:41005] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:44283 2023-09-14 07:00:58,119 DEBUG [RS:2;jenkins-hbase4:41005] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-14 07:00:58,120 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-09-14 07:00:58,120 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-09-14 07:00:58,131 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-09-14 07:00:58,132 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-14 07:00:58,133 DEBUG [RS:1;jenkins-hbase4:37703] zookeeper.ZKUtil(162): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:00:58,134 WARN [RS:1;jenkins-hbase4:37703] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-14 07:00:58,134 DEBUG [RS:2;jenkins-hbase4:41005] zookeeper.ZKUtil(162): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:00:58,134 INFO [RS:1;jenkins-hbase4:37703] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-14 07:00:58,134 DEBUG [RS:0;jenkins-hbase4:35941] zookeeper.ZKUtil(162): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:00:58,134 WARN [RS:2;jenkins-hbase4:41005] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-14 07:00:58,135 DEBUG [RS:1;jenkins-hbase4:37703] regionserver.HRegionServer(1948): logDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/WALs/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:00:58,135 INFO [RS:2;jenkins-hbase4:41005] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-14 07:00:58,135 DEBUG [RS:2;jenkins-hbase4:41005] regionserver.HRegionServer(1948): logDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/WALs/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:00:58,134 WARN [RS:0;jenkins-hbase4:35941] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-14 07:00:58,137 INFO [RS:0;jenkins-hbase4:35941] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-14 07:00:58,138 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35941,1694674856649] 2023-09-14 07:00:58,138 DEBUG [RS:0;jenkins-hbase4:35941] regionserver.HRegionServer(1948): logDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/WALs/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:00:58,138 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41005,1694674856735] 2023-09-14 07:00:58,138 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37703,1694674856695] 2023-09-14 07:00:58,153 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-09-14 07:00:58,155 DEBUG [RS:1;jenkins-hbase4:37703] zookeeper.ZKUtil(162): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:00:58,156 DEBUG [RS:0;jenkins-hbase4:35941] zookeeper.ZKUtil(162): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:00:58,156 DEBUG [RS:2;jenkins-hbase4:41005] zookeeper.ZKUtil(162): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:00:58,156 DEBUG [RS:1;jenkins-hbase4:37703] zookeeper.ZKUtil(162): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:00:58,157 DEBUG [RS:2;jenkins-hbase4:41005] zookeeper.ZKUtil(162): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:00:58,157 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-09-14 07:00:58,157 DEBUG [RS:0;jenkins-hbase4:35941] zookeeper.ZKUtil(162): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:00:58,158 DEBUG [RS:2;jenkins-hbase4:41005] zookeeper.ZKUtil(162): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:00:58,158 DEBUG [RS:1;jenkins-hbase4:37703] zookeeper.ZKUtil(162): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:00:58,158 DEBUG [RS:0;jenkins-hbase4:35941] zookeeper.ZKUtil(162): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:00:58,171 DEBUG [RS:2;jenkins-hbase4:41005] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-14 07:00:58,171 DEBUG [RS:1;jenkins-hbase4:37703] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-14 07:00:58,171 DEBUG [RS:0;jenkins-hbase4:35941] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-14 07:00:58,182 INFO [RS:2;jenkins-hbase4:41005] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-14 07:00:58,182 INFO [RS:1;jenkins-hbase4:37703] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-14 07:00:58,182 INFO [RS:0;jenkins-hbase4:35941] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-14 07:00:58,207 INFO [RS:1;jenkins-hbase4:37703] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-14 07:00:58,207 INFO [RS:0;jenkins-hbase4:35941] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-14 07:00:58,207 INFO [RS:2;jenkins-hbase4:41005] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-14 07:00:58,212 INFO [RS:2;jenkins-hbase4:41005] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-14 07:00:58,212 INFO [RS:1;jenkins-hbase4:37703] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-14 07:00:58,212 INFO [RS:2;jenkins-hbase4:41005] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-14 07:00:58,212 INFO [RS:0;jenkins-hbase4:35941] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-14 07:00:58,212 INFO [RS:1;jenkins-hbase4:37703] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-14 07:00:58,213 INFO [RS:0;jenkins-hbase4:35941] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-14 07:00:58,214 INFO [RS:1;jenkins-hbase4:37703] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-14 07:00:58,214 INFO [RS:0;jenkins-hbase4:35941] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-14 07:00:58,214 INFO [RS:2;jenkins-hbase4:41005] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-14 07:00:58,223 INFO [RS:0;jenkins-hbase4:35941] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-14 07:00:58,223 INFO [RS:2;jenkins-hbase4:41005] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-14 07:00:58,223 INFO [RS:1;jenkins-hbase4:37703] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-14 07:00:58,223 DEBUG [RS:0;jenkins-hbase4:35941] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 07:00:58,223 DEBUG [RS:2;jenkins-hbase4:41005] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 07:00:58,224 DEBUG [RS:0;jenkins-hbase4:35941] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 07:00:58,224 DEBUG [RS:1;jenkins-hbase4:37703] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 07:00:58,224 DEBUG [RS:0;jenkins-hbase4:35941] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 07:00:58,224 DEBUG [RS:1;jenkins-hbase4:37703] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 07:00:58,224 DEBUG [RS:0;jenkins-hbase4:35941] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 07:00:58,224 DEBUG [RS:1;jenkins-hbase4:37703] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 07:00:58,224 DEBUG [RS:0;jenkins-hbase4:35941] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 07:00:58,224 DEBUG [RS:1;jenkins-hbase4:37703] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 07:00:58,224 DEBUG [RS:0;jenkins-hbase4:35941] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-14 07:00:58,224 DEBUG [RS:1;jenkins-hbase4:37703] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 07:00:58,224 DEBUG [RS:0;jenkins-hbase4:35941] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 07:00:58,224 DEBUG [RS:1;jenkins-hbase4:37703] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-14 07:00:58,224 DEBUG [RS:2;jenkins-hbase4:41005] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 07:00:58,225 DEBUG [RS:1;jenkins-hbase4:37703] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 07:00:58,225 DEBUG [RS:0;jenkins-hbase4:35941] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 07:00:58,225 DEBUG [RS:1;jenkins-hbase4:37703] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 07:00:58,225 DEBUG [RS:0;jenkins-hbase4:35941] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 07:00:58,225 DEBUG [RS:1;jenkins-hbase4:37703] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 07:00:58,225 DEBUG [RS:0;jenkins-hbase4:35941] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 07:00:58,225 DEBUG [RS:2;jenkins-hbase4:41005] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 07:00:58,225 DEBUG [RS:1;jenkins-hbase4:37703] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 07:00:58,225 DEBUG [RS:2;jenkins-hbase4:41005] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 07:00:58,225 DEBUG [RS:2;jenkins-hbase4:41005] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 07:00:58,225 DEBUG [RS:2;jenkins-hbase4:41005] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-14 07:00:58,226 DEBUG [RS:2;jenkins-hbase4:41005] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 07:00:58,226 INFO [RS:1;jenkins-hbase4:37703] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-14 07:00:58,226 DEBUG [RS:2;jenkins-hbase4:41005] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 07:00:58,227 INFO [RS:0;jenkins-hbase4:35941] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-14 07:00:58,227 DEBUG [RS:2;jenkins-hbase4:41005] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 07:00:58,227 INFO [RS:0;jenkins-hbase4:35941] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-14 07:00:58,227 DEBUG [RS:2;jenkins-hbase4:41005] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 07:00:58,227 INFO [RS:0;jenkins-hbase4:35941] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-14 07:00:58,227 INFO [RS:1;jenkins-hbase4:37703] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-14 07:00:58,227 INFO [RS:1;jenkins-hbase4:37703] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-14 07:00:58,232 INFO [RS:2;jenkins-hbase4:41005] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-14 07:00:58,232 INFO [RS:2;jenkins-hbase4:41005] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-14 07:00:58,232 INFO [RS:2;jenkins-hbase4:41005] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-14 07:00:58,250 INFO [RS:2;jenkins-hbase4:41005] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-14 07:00:58,251 INFO [RS:1;jenkins-hbase4:37703] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-14 07:00:58,250 INFO [RS:0;jenkins-hbase4:35941] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-14 07:00:58,255 INFO [RS:2;jenkins-hbase4:41005] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41005,1694674856735-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-14 07:00:58,255 INFO [RS:1;jenkins-hbase4:37703] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37703,1694674856695-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-14 07:00:58,255 INFO [RS:0;jenkins-hbase4:35941] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35941,1694674856649-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-14 07:00:58,276 INFO [RS:0;jenkins-hbase4:35941] regionserver.Replication(203): jenkins-hbase4.apache.org,35941,1694674856649 started 2023-09-14 07:00:58,276 INFO [RS:0;jenkins-hbase4:35941] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,35941,1694674856649, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35941, sessionid=0x100a93d59ec0001 2023-09-14 07:00:58,276 DEBUG [RS:0;jenkins-hbase4:35941] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-14 07:00:58,276 DEBUG [RS:0;jenkins-hbase4:35941] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:00:58,276 DEBUG [RS:0;jenkins-hbase4:35941] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35941,1694674856649' 2023-09-14 07:00:58,276 DEBUG [RS:0;jenkins-hbase4:35941] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-14 07:00:58,277 DEBUG [RS:0;jenkins-hbase4:35941] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-14 07:00:58,277 INFO [RS:1;jenkins-hbase4:37703] regionserver.Replication(203): jenkins-hbase4.apache.org,37703,1694674856695 started 2023-09-14 07:00:58,277 INFO [RS:1;jenkins-hbase4:37703] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,37703,1694674856695, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37703, sessionid=0x100a93d59ec0002 2023-09-14 07:00:58,278 INFO [RS:2;jenkins-hbase4:41005] regionserver.Replication(203): jenkins-hbase4.apache.org,41005,1694674856735 started 2023-09-14 07:00:58,278 INFO [RS:2;jenkins-hbase4:41005] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,41005,1694674856735, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41005, sessionid=0x100a93d59ec0003 2023-09-14 07:00:58,278 DEBUG [RS:2;jenkins-hbase4:41005] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-14 07:00:58,278 DEBUG [RS:1;jenkins-hbase4:37703] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-14 07:00:58,279 DEBUG [RS:0;jenkins-hbase4:35941] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-14 07:00:58,279 DEBUG [RS:1;jenkins-hbase4:37703] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:00:58,278 DEBUG [RS:2;jenkins-hbase4:41005] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:00:58,279 DEBUG [RS:1;jenkins-hbase4:37703] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37703,1694674856695' 2023-09-14 07:00:58,279 DEBUG [RS:0;jenkins-hbase4:35941] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-14 07:00:58,280 DEBUG [RS:1;jenkins-hbase4:37703] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-14 07:00:58,280 DEBUG [RS:2;jenkins-hbase4:41005] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41005,1694674856735' 2023-09-14 07:00:58,280 DEBUG [RS:0;jenkins-hbase4:35941] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:00:58,280 DEBUG [RS:2;jenkins-hbase4:41005] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-14 07:00:58,280 DEBUG [RS:0;jenkins-hbase4:35941] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35941,1694674856649' 2023-09-14 07:00:58,281 DEBUG [RS:0;jenkins-hbase4:35941] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:00:58,281 DEBUG [RS:1;jenkins-hbase4:37703] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-14 07:00:58,281 DEBUG [RS:2;jenkins-hbase4:41005] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-14 07:00:58,281 DEBUG [RS:0;jenkins-hbase4:35941] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:00:58,281 DEBUG [RS:1;jenkins-hbase4:37703] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-14 07:00:58,282 DEBUG [RS:1;jenkins-hbase4:37703] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-14 07:00:58,282 DEBUG [RS:1;jenkins-hbase4:37703] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:00:58,283 DEBUG [RS:2;jenkins-hbase4:41005] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-14 07:00:58,283 DEBUG [RS:1;jenkins-hbase4:37703] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37703,1694674856695' 2023-09-14 07:00:58,284 DEBUG [RS:0;jenkins-hbase4:35941] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-14 07:00:58,284 DEBUG [RS:2;jenkins-hbase4:41005] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-14 07:00:58,284 INFO [RS:0;jenkins-hbase4:35941] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-14 07:00:58,284 DEBUG [RS:1;jenkins-hbase4:37703] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:00:58,284 INFO [RS:0;jenkins-hbase4:35941] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-14 07:00:58,284 DEBUG [RS:2;jenkins-hbase4:41005] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:00:58,284 DEBUG [RS:2;jenkins-hbase4:41005] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41005,1694674856735' 2023-09-14 07:00:58,284 DEBUG [RS:2;jenkins-hbase4:41005] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:00:58,285 DEBUG [RS:1;jenkins-hbase4:37703] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:00:58,285 DEBUG [RS:2;jenkins-hbase4:41005] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:00:58,285 DEBUG [RS:1;jenkins-hbase4:37703] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-14 07:00:58,286 INFO [RS:1;jenkins-hbase4:37703] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-14 07:00:58,286 INFO [RS:1;jenkins-hbase4:37703] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-14 07:00:58,286 DEBUG [RS:2;jenkins-hbase4:41005] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-14 07:00:58,286 INFO [RS:2;jenkins-hbase4:41005] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-14 07:00:58,286 INFO [RS:2;jenkins-hbase4:41005] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-14 07:00:58,309 DEBUG [jenkins-hbase4:33055] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-09-14 07:00:58,313 DEBUG [jenkins-hbase4:33055] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-14 07:00:58,319 DEBUG [jenkins-hbase4:33055] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-14 07:00:58,319 DEBUG [jenkins-hbase4:33055] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-14 07:00:58,319 DEBUG [jenkins-hbase4:33055] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-14 07:00:58,319 DEBUG [jenkins-hbase4:33055] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-14 07:00:58,323 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,37703,1694674856695, state=OPENING 2023-09-14 07:00:58,333 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-09-14 07:00:58,335 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-14 07:00:58,335 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-14 07:00:58,339 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,37703,1694674856695}] 2023-09-14 07:00:58,396 INFO [RS:2;jenkins-hbase4:41005] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41005%2C1694674856735, suffix=, logDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/WALs/jenkins-hbase4.apache.org,41005,1694674856735, archiveDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/oldWALs, maxLogs=32 2023-09-14 07:00:58,396 INFO [RS:0;jenkins-hbase4:35941] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35941%2C1694674856649, suffix=, logDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/WALs/jenkins-hbase4.apache.org,35941,1694674856649, archiveDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/oldWALs, maxLogs=32 2023-09-14 07:00:58,396 INFO [RS:1;jenkins-hbase4:37703] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37703%2C1694674856695, suffix=, logDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/WALs/jenkins-hbase4.apache.org,37703,1694674856695, archiveDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/oldWALs, maxLogs=32 2023-09-14 07:00:58,438 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34299,DS-d15af083-fca4-4977-b008-202db79f5b06,DISK] 2023-09-14 07:00:58,438 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45741,DS-2e2b40aa-573e-49ed-9327-bf5c6ea00025,DISK] 2023-09-14 07:00:58,438 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45741,DS-2e2b40aa-573e-49ed-9327-bf5c6ea00025,DISK] 2023-09-14 07:00:58,439 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38597,DS-9a8f7d0c-bb3e-4f4c-bb7c-c31ddcb30ee9,DISK] 2023-09-14 07:00:58,444 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38597,DS-9a8f7d0c-bb3e-4f4c-bb7c-c31ddcb30ee9,DISK] 2023-09-14 07:00:58,445 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34299,DS-d15af083-fca4-4977-b008-202db79f5b06,DISK] 2023-09-14 07:00:58,445 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34299,DS-d15af083-fca4-4977-b008-202db79f5b06,DISK] 2023-09-14 07:00:58,445 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45741,DS-2e2b40aa-573e-49ed-9327-bf5c6ea00025,DISK] 2023-09-14 07:00:58,445 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38597,DS-9a8f7d0c-bb3e-4f4c-bb7c-c31ddcb30ee9,DISK] 2023-09-14 07:00:58,470 INFO [RS:1;jenkins-hbase4:37703] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/WALs/jenkins-hbase4.apache.org,37703,1694674856695/jenkins-hbase4.apache.org%2C37703%2C1694674856695.1694674858401 2023-09-14 07:00:58,471 INFO [RS:0;jenkins-hbase4:35941] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/WALs/jenkins-hbase4.apache.org,35941,1694674856649/jenkins-hbase4.apache.org%2C35941%2C1694674856649.1694674858401 2023-09-14 07:00:58,471 INFO [RS:2;jenkins-hbase4:41005] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/WALs/jenkins-hbase4.apache.org,41005,1694674856735/jenkins-hbase4.apache.org%2C41005%2C1694674856735.1694674858401 2023-09-14 07:00:58,472 DEBUG [RS:1;jenkins-hbase4:37703] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45741,DS-2e2b40aa-573e-49ed-9327-bf5c6ea00025,DISK], DatanodeInfoWithStorage[127.0.0.1:38597,DS-9a8f7d0c-bb3e-4f4c-bb7c-c31ddcb30ee9,DISK], DatanodeInfoWithStorage[127.0.0.1:34299,DS-d15af083-fca4-4977-b008-202db79f5b06,DISK]] 2023-09-14 07:00:58,473 DEBUG [RS:0;jenkins-hbase4:35941] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45741,DS-2e2b40aa-573e-49ed-9327-bf5c6ea00025,DISK], DatanodeInfoWithStorage[127.0.0.1:34299,DS-d15af083-fca4-4977-b008-202db79f5b06,DISK], DatanodeInfoWithStorage[127.0.0.1:38597,DS-9a8f7d0c-bb3e-4f4c-bb7c-c31ddcb30ee9,DISK]] 2023-09-14 07:00:58,477 DEBUG [RS:2;jenkins-hbase4:41005] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38597,DS-9a8f7d0c-bb3e-4f4c-bb7c-c31ddcb30ee9,DISK], DatanodeInfoWithStorage[127.0.0.1:34299,DS-d15af083-fca4-4977-b008-202db79f5b06,DISK], DatanodeInfoWithStorage[127.0.0.1:45741,DS-2e2b40aa-573e-49ed-9327-bf5c6ea00025,DISK]] 2023-09-14 07:00:58,525 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:00:58,527 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-14 07:00:58,530 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45314, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-14 07:00:58,545 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-09-14 07:00:58,546 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-14 07:00:58,549 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37703%2C1694674856695.meta, suffix=.meta, logDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/WALs/jenkins-hbase4.apache.org,37703,1694674856695, archiveDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/oldWALs, maxLogs=32 2023-09-14 07:00:58,570 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38597,DS-9a8f7d0c-bb3e-4f4c-bb7c-c31ddcb30ee9,DISK] 2023-09-14 07:00:58,570 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45741,DS-2e2b40aa-573e-49ed-9327-bf5c6ea00025,DISK] 2023-09-14 07:00:58,572 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34299,DS-d15af083-fca4-4977-b008-202db79f5b06,DISK] 2023-09-14 07:00:58,579 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/WALs/jenkins-hbase4.apache.org,37703,1694674856695/jenkins-hbase4.apache.org%2C37703%2C1694674856695.meta.1694674858551.meta 2023-09-14 07:00:58,581 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45741,DS-2e2b40aa-573e-49ed-9327-bf5c6ea00025,DISK], DatanodeInfoWithStorage[127.0.0.1:38597,DS-9a8f7d0c-bb3e-4f4c-bb7c-c31ddcb30ee9,DISK], DatanodeInfoWithStorage[127.0.0.1:34299,DS-d15af083-fca4-4977-b008-202db79f5b06,DISK]] 2023-09-14 07:00:58,581 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-09-14 07:00:58,582 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-09-14 07:00:58,583 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-14 07:00:58,584 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-09-14 07:00:58,586 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-09-14 07:00:58,588 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-09-14 07:00:58,605 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-09-14 07:00:58,605 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 07:00:58,605 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-09-14 07:00:58,605 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-09-14 07:00:58,608 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-14 07:00:58,610 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/hbase/meta/1588230740/info 2023-09-14 07:00:58,610 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/hbase/meta/1588230740/info 2023-09-14 07:00:58,611 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-14 07:00:58,612 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-14 07:00:58,612 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-14 07:00:58,613 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/hbase/meta/1588230740/rep_barrier 2023-09-14 07:00:58,613 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/hbase/meta/1588230740/rep_barrier 2023-09-14 07:00:58,614 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-14 07:00:58,614 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-14 07:00:58,615 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-14 07:00:58,616 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/hbase/meta/1588230740/table 2023-09-14 07:00:58,616 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/hbase/meta/1588230740/table 2023-09-14 07:00:58,616 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-14 07:00:58,617 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-14 07:00:58,619 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/hbase/meta/1588230740 2023-09-14 07:00:58,622 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/hbase/meta/1588230740 2023-09-14 07:00:58,626 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-14 07:00:58,629 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-14 07:00:58,631 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66367957, jitterRate=-0.011040374636650085}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-14 07:00:58,634 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-14 07:00:58,648 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1694674858516 2023-09-14 07:00:58,669 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-09-14 07:00:58,670 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-09-14 07:00:58,670 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,37703,1694674856695, state=OPEN 2023-09-14 07:00:58,673 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-09-14 07:00:58,673 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-14 07:00:58,677 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-09-14 07:00:58,677 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,37703,1694674856695 in 334 msec 2023-09-14 07:00:58,683 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-09-14 07:00:58,683 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 548 msec 2023-09-14 07:00:58,687 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 836 msec 2023-09-14 07:00:58,688 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1694674858688, completionTime=-1 2023-09-14 07:00:58,688 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-09-14 07:00:58,688 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-09-14 07:00:58,758 DEBUG [hconnection-0x3a740ce4-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 07:00:58,761 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45328, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 07:00:58,781 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-09-14 07:00:58,781 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1694674918781 2023-09-14 07:00:58,781 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1694674978781 2023-09-14 07:00:58,782 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 93 msec 2023-09-14 07:00:58,810 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33055,1694674855392-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-14 07:00:58,810 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33055,1694674855392-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-14 07:00:58,810 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33055,1694674855392-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-14 07:00:58,812 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:33055, period=300000, unit=MILLISECONDS is enabled. 2023-09-14 07:00:58,812 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-09-14 07:00:58,820 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-09-14 07:00:58,831 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-09-14 07:00:58,832 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-14 07:00:58,843 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-09-14 07:00:58,845 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-09-14 07:00:58,849 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-14 07:00:58,879 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/hbase/namespace/5e9aa8df1b0f6db9264d5b3afa60477d 2023-09-14 07:00:58,883 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/hbase/namespace/5e9aa8df1b0f6db9264d5b3afa60477d empty. 2023-09-14 07:00:58,884 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/hbase/namespace/5e9aa8df1b0f6db9264d5b3afa60477d 2023-09-14 07:00:58,885 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-09-14 07:00:58,961 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-09-14 07:00:58,963 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5e9aa8df1b0f6db9264d5b3afa60477d, NAME => 'hbase:namespace,,1694674858832.5e9aa8df1b0f6db9264d5b3afa60477d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp 2023-09-14 07:00:58,982 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1694674858832.5e9aa8df1b0f6db9264d5b3afa60477d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 07:00:58,982 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 5e9aa8df1b0f6db9264d5b3afa60477d, disabling compactions & flushes 2023-09-14 07:00:58,982 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1694674858832.5e9aa8df1b0f6db9264d5b3afa60477d. 2023-09-14 07:00:58,982 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1694674858832.5e9aa8df1b0f6db9264d5b3afa60477d. 2023-09-14 07:00:58,982 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1694674858832.5e9aa8df1b0f6db9264d5b3afa60477d. after waiting 0 ms 2023-09-14 07:00:58,982 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1694674858832.5e9aa8df1b0f6db9264d5b3afa60477d. 2023-09-14 07:00:58,983 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1694674858832.5e9aa8df1b0f6db9264d5b3afa60477d. 2023-09-14 07:00:58,983 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 5e9aa8df1b0f6db9264d5b3afa60477d: 2023-09-14 07:00:58,987 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-09-14 07:00:59,001 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1694674858832.5e9aa8df1b0f6db9264d5b3afa60477d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1694674858990"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694674858990"}]},"ts":"1694674858990"} 2023-09-14 07:00:59,032 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-14 07:00:59,035 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-14 07:00:59,039 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694674859035"}]},"ts":"1694674859035"} 2023-09-14 07:00:59,043 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-09-14 07:00:59,047 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-14 07:00:59,048 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-14 07:00:59,048 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-14 07:00:59,048 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-14 07:00:59,048 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-14 07:00:59,054 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=5e9aa8df1b0f6db9264d5b3afa60477d, ASSIGN}] 2023-09-14 07:00:59,058 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=5e9aa8df1b0f6db9264d5b3afa60477d, ASSIGN 2023-09-14 07:00:59,060 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=5e9aa8df1b0f6db9264d5b3afa60477d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41005,1694674856735; forceNewPlan=false, retain=false 2023-09-14 07:00:59,212 INFO [jenkins-hbase4:33055] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-14 07:00:59,214 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=5e9aa8df1b0f6db9264d5b3afa60477d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:00:59,214 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1694674858832.5e9aa8df1b0f6db9264d5b3afa60477d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1694674859214"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694674859214"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694674859214"}]},"ts":"1694674859214"} 2023-09-14 07:00:59,219 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 5e9aa8df1b0f6db9264d5b3afa60477d, server=jenkins-hbase4.apache.org,41005,1694674856735}] 2023-09-14 07:00:59,374 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:00:59,374 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-14 07:00:59,377 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56028, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-14 07:00:59,383 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1694674858832.5e9aa8df1b0f6db9264d5b3afa60477d. 2023-09-14 07:00:59,384 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5e9aa8df1b0f6db9264d5b3afa60477d, NAME => 'hbase:namespace,,1694674858832.5e9aa8df1b0f6db9264d5b3afa60477d.', STARTKEY => '', ENDKEY => ''} 2023-09-14 07:00:59,384 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1694674858832.5e9aa8df1b0f6db9264d5b3afa60477d. service=AccessControlService 2023-09-14 07:00:59,385 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-14 07:00:59,385 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 5e9aa8df1b0f6db9264d5b3afa60477d 2023-09-14 07:00:59,385 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1694674858832.5e9aa8df1b0f6db9264d5b3afa60477d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 07:00:59,385 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5e9aa8df1b0f6db9264d5b3afa60477d 2023-09-14 07:00:59,385 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5e9aa8df1b0f6db9264d5b3afa60477d 2023-09-14 07:00:59,388 INFO [StoreOpener-5e9aa8df1b0f6db9264d5b3afa60477d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 5e9aa8df1b0f6db9264d5b3afa60477d 2023-09-14 07:00:59,390 DEBUG [StoreOpener-5e9aa8df1b0f6db9264d5b3afa60477d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/hbase/namespace/5e9aa8df1b0f6db9264d5b3afa60477d/info 2023-09-14 07:00:59,390 DEBUG [StoreOpener-5e9aa8df1b0f6db9264d5b3afa60477d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/hbase/namespace/5e9aa8df1b0f6db9264d5b3afa60477d/info 2023-09-14 07:00:59,391 INFO [StoreOpener-5e9aa8df1b0f6db9264d5b3afa60477d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5e9aa8df1b0f6db9264d5b3afa60477d columnFamilyName info 2023-09-14 07:00:59,392 INFO [StoreOpener-5e9aa8df1b0f6db9264d5b3afa60477d-1] regionserver.HStore(310): Store=5e9aa8df1b0f6db9264d5b3afa60477d/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-14 07:00:59,394 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/hbase/namespace/5e9aa8df1b0f6db9264d5b3afa60477d 2023-09-14 07:00:59,395 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/hbase/namespace/5e9aa8df1b0f6db9264d5b3afa60477d 2023-09-14 07:00:59,399 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5e9aa8df1b0f6db9264d5b3afa60477d 2023-09-14 07:00:59,404 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/hbase/namespace/5e9aa8df1b0f6db9264d5b3afa60477d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-14 07:00:59,405 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5e9aa8df1b0f6db9264d5b3afa60477d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69667205, jitterRate=0.03812225162982941}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-14 07:00:59,405 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5e9aa8df1b0f6db9264d5b3afa60477d: 2023-09-14 07:00:59,407 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1694674858832.5e9aa8df1b0f6db9264d5b3afa60477d., pid=6, masterSystemTime=1694674859374 2023-09-14 07:00:59,412 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1694674858832.5e9aa8df1b0f6db9264d5b3afa60477d. 2023-09-14 07:00:59,412 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1694674858832.5e9aa8df1b0f6db9264d5b3afa60477d. 2023-09-14 07:00:59,413 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=5e9aa8df1b0f6db9264d5b3afa60477d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:00:59,414 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1694674858832.5e9aa8df1b0f6db9264d5b3afa60477d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1694674859413"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694674859413"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694674859413"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694674859413"}]},"ts":"1694674859413"} 2023-09-14 07:00:59,421 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-09-14 07:00:59,421 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 5e9aa8df1b0f6db9264d5b3afa60477d, server=jenkins-hbase4.apache.org,41005,1694674856735 in 198 msec 2023-09-14 07:00:59,425 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-09-14 07:00:59,426 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=5e9aa8df1b0f6db9264d5b3afa60477d, ASSIGN in 367 msec 2023-09-14 07:00:59,427 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-14 07:00:59,427 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694674859427"}]},"ts":"1694674859427"} 2023-09-14 07:00:59,429 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-09-14 07:00:59,434 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-09-14 07:00:59,437 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 601 msec 2023-09-14 07:00:59,453 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-09-14 07:00:59,454 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-09-14 07:00:59,454 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-14 07:00:59,475 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 07:00:59,477 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56034, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 07:00:59,490 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-09-14 07:00:59,505 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-14 07:00:59,512 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 28 msec 2023-09-14 07:00:59,523 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-09-14 07:00:59,535 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-14 07:00:59,540 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2023-09-14 07:00:59,548 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-09-14 07:00:59,551 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-09-14 07:00:59,551 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.741sec 2023-09-14 07:00:59,555 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-09-14 07:00:59,557 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-09-14 07:00:59,557 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-09-14 07:00:59,559 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33055,1694674855392-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-09-14 07:00:59,560 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33055,1694674855392-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-09-14 07:00:59,577 DEBUG [Listener at localhost/35097] zookeeper.ReadOnlyZKClient(139): Connect 0x392976b2 to 127.0.0.1:52295 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 07:00:59,582 DEBUG [Listener at localhost/35097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@45bc384d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 07:00:59,591 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-14 07:00:59,594 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-09-14 07:00:59,597 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-09-14 07:00:59,598 DEBUG [hconnection-0x38d5a78c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 07:00:59,599 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-14 07:00:59,602 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-09-14 07:00:59,603 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/hbase/acl/e8c7a8a714ce5b83c0178f59f5b781c8 2023-09-14 07:00:59,604 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/hbase/acl/e8c7a8a714ce5b83c0178f59f5b781c8 empty. 2023-09-14 07:00:59,607 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/hbase/acl/e8c7a8a714ce5b83c0178f59f5b781c8 2023-09-14 07:00:59,607 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-09-14 07:00:59,612 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-14 07:00:59,614 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45338, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 07:00:59,617 INFO [Listener at localhost/35097] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,33055,1694674855392 2023-09-14 07:00:59,618 INFO [Listener at localhost/35097] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-09-14 07:00:59,618 INFO [Listener at localhost/35097] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/test.cache.data in system properties and HBase conf 2023-09-14 07:00:59,618 INFO [Listener at localhost/35097] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/hadoop.tmp.dir in system properties and HBase conf 2023-09-14 07:00:59,618 INFO [Listener at localhost/35097] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/hadoop.log.dir in system properties and HBase conf 2023-09-14 07:00:59,618 INFO [Listener at localhost/35097] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-14 07:00:59,618 INFO [Listener at localhost/35097] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-14 07:00:59,618 INFO [Listener at localhost/35097] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-14 07:00:59,619 INFO [Listener at localhost/35097] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-14 07:00:59,619 INFO [Listener at localhost/35097] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-14 07:00:59,619 INFO [Listener at localhost/35097] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-14 07:00:59,619 INFO [Listener at localhost/35097] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-14 07:00:59,619 INFO [Listener at localhost/35097] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-14 07:00:59,619 INFO [Listener at localhost/35097] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-14 07:00:59,619 INFO [Listener at localhost/35097] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-14 07:00:59,619 INFO [Listener at localhost/35097] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-14 07:00:59,619 INFO [Listener at localhost/35097] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-14 07:00:59,619 INFO [Listener at localhost/35097] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/nfs.dump.dir in system properties and HBase conf 2023-09-14 07:00:59,620 INFO [Listener at localhost/35097] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/java.io.tmpdir in system properties and HBase conf 2023-09-14 07:00:59,620 INFO [Listener at localhost/35097] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-14 07:00:59,620 INFO [Listener at localhost/35097] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-14 07:00:59,620 INFO [Listener at localhost/35097] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-09-14 07:00:59,634 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-09-14 07:00:59,636 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => e8c7a8a714ce5b83c0178f59f5b781c8, NAME => 'hbase:acl,,1694674859583.e8c7a8a714ce5b83c0178f59f5b781c8.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp 2023-09-14 07:00:59,666 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1694674859583.e8c7a8a714ce5b83c0178f59f5b781c8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 07:00:59,666 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing e8c7a8a714ce5b83c0178f59f5b781c8, disabling compactions & flushes 2023-09-14 07:00:59,666 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1694674859583.e8c7a8a714ce5b83c0178f59f5b781c8. 2023-09-14 07:00:59,666 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1694674859583.e8c7a8a714ce5b83c0178f59f5b781c8. 2023-09-14 07:00:59,666 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1694674859583.e8c7a8a714ce5b83c0178f59f5b781c8. after waiting 0 ms 2023-09-14 07:00:59,666 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1694674859583.e8c7a8a714ce5b83c0178f59f5b781c8. 2023-09-14 07:00:59,666 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1694674859583.e8c7a8a714ce5b83c0178f59f5b781c8. 2023-09-14 07:00:59,666 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for e8c7a8a714ce5b83c0178f59f5b781c8: 2023-09-14 07:00:59,673 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-09-14 07:00:59,681 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1694674859583.e8c7a8a714ce5b83c0178f59f5b781c8.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1694674859680"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694674859680"}]},"ts":"1694674859680"} 2023-09-14 07:00:59,685 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-14 07:00:59,687 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-14 07:00:59,687 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694674859687"}]},"ts":"1694674859687"} 2023-09-14 07:00:59,691 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-09-14 07:00:59,696 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-14 07:00:59,697 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-14 07:00:59,697 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-14 07:00:59,697 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-14 07:00:59,697 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-14 07:00:59,697 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=e8c7a8a714ce5b83c0178f59f5b781c8, ASSIGN}] 2023-09-14 07:00:59,700 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=e8c7a8a714ce5b83c0178f59f5b781c8, ASSIGN 2023-09-14 07:00:59,703 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=e8c7a8a714ce5b83c0178f59f5b781c8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35941,1694674856649; forceNewPlan=false, retain=false 2023-09-14 07:00:59,718 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-14 07:00:59,854 INFO [jenkins-hbase4:33055] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-14 07:00:59,855 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=e8c7a8a714ce5b83c0178f59f5b781c8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:00:59,855 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1694674859583.e8c7a8a714ce5b83c0178f59f5b781c8.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1694674859855"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694674859855"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694674859855"}]},"ts":"1694674859855"} 2023-09-14 07:00:59,859 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure e8c7a8a714ce5b83c0178f59f5b781c8, server=jenkins-hbase4.apache.org,35941,1694674856649}] 2023-09-14 07:00:59,918 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-14 07:01:00,014 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:00,014 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-14 07:01:00,018 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43078, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-14 07:01:00,033 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1694674859583.e8c7a8a714ce5b83c0178f59f5b781c8. 2023-09-14 07:01:00,034 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e8c7a8a714ce5b83c0178f59f5b781c8, NAME => 'hbase:acl,,1694674859583.e8c7a8a714ce5b83c0178f59f5b781c8.', STARTKEY => '', ENDKEY => ''} 2023-09-14 07:01:00,034 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1694674859583.e8c7a8a714ce5b83c0178f59f5b781c8. service=AccessControlService 2023-09-14 07:01:00,037 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-14 07:01:00,037 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl e8c7a8a714ce5b83c0178f59f5b781c8 2023-09-14 07:01:00,037 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1694674859583.e8c7a8a714ce5b83c0178f59f5b781c8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 07:01:00,038 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e8c7a8a714ce5b83c0178f59f5b781c8 2023-09-14 07:01:00,038 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e8c7a8a714ce5b83c0178f59f5b781c8 2023-09-14 07:01:00,040 INFO [StoreOpener-e8c7a8a714ce5b83c0178f59f5b781c8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region e8c7a8a714ce5b83c0178f59f5b781c8 2023-09-14 07:01:00,042 DEBUG [StoreOpener-e8c7a8a714ce5b83c0178f59f5b781c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/hbase/acl/e8c7a8a714ce5b83c0178f59f5b781c8/l 2023-09-14 07:01:00,042 DEBUG [StoreOpener-e8c7a8a714ce5b83c0178f59f5b781c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/hbase/acl/e8c7a8a714ce5b83c0178f59f5b781c8/l 2023-09-14 07:01:00,042 INFO [StoreOpener-e8c7a8a714ce5b83c0178f59f5b781c8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e8c7a8a714ce5b83c0178f59f5b781c8 columnFamilyName l 2023-09-14 07:01:00,043 INFO [StoreOpener-e8c7a8a714ce5b83c0178f59f5b781c8-1] regionserver.HStore(310): Store=e8c7a8a714ce5b83c0178f59f5b781c8/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-14 07:01:00,045 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/hbase/acl/e8c7a8a714ce5b83c0178f59f5b781c8 2023-09-14 07:01:00,046 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/hbase/acl/e8c7a8a714ce5b83c0178f59f5b781c8 2023-09-14 07:01:00,054 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e8c7a8a714ce5b83c0178f59f5b781c8 2023-09-14 07:01:00,058 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/hbase/acl/e8c7a8a714ce5b83c0178f59f5b781c8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-14 07:01:00,060 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e8c7a8a714ce5b83c0178f59f5b781c8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62103541, jitterRate=-0.07458512485027313}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-14 07:01:00,060 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e8c7a8a714ce5b83c0178f59f5b781c8: 2023-09-14 07:01:00,062 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1694674859583.e8c7a8a714ce5b83c0178f59f5b781c8., pid=11, masterSystemTime=1694674860014 2023-09-14 07:01:00,066 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1694674859583.e8c7a8a714ce5b83c0178f59f5b781c8. 2023-09-14 07:01:00,067 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1694674859583.e8c7a8a714ce5b83c0178f59f5b781c8. 2023-09-14 07:01:00,068 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=e8c7a8a714ce5b83c0178f59f5b781c8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:00,068 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1694674859583.e8c7a8a714ce5b83c0178f59f5b781c8.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1694674860068"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694674860068"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694674860068"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694674860068"}]},"ts":"1694674860068"} 2023-09-14 07:01:00,075 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-09-14 07:01:00,075 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure e8c7a8a714ce5b83c0178f59f5b781c8, server=jenkins-hbase4.apache.org,35941,1694674856649 in 212 msec 2023-09-14 07:01:00,079 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-09-14 07:01:00,079 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=e8c7a8a714ce5b83c0178f59f5b781c8, ASSIGN in 378 msec 2023-09-14 07:01:00,081 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-14 07:01:00,081 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694674860081"}]},"ts":"1694674860081"} 2023-09-14 07:01:00,083 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-09-14 07:01:00,087 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-09-14 07:01:00,090 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 495 msec 2023-09-14 07:01:00,219 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-14 07:01:00,219 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-09-14 07:01:00,228 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-09-14 07:01:00,783 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-14 07:01:01,164 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-09-14 07:01:01,171 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_33355_jobhistory____pfks64/webapp 2023-09-14 07:01:01,352 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-09-14 07:01:01,352 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-09-14 07:01:01,352 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-14 07:01:01,355 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-14 07:01:01,461 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-14 07:01:01,809 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-14 07:01:02,124 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-09-14 07:01:02,156 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:33355 2023-09-14 07:01:02,278 WARN [Listener at jenkins-hbase4.apache.org/33915] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-14 07:01:02,583 WARN [Listener at jenkins-hbase4.apache.org/33915] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-14 07:01:02,584 INFO [Listener at jenkins-hbase4.apache.org/33915] log.Slf4jLog(67): jetty-6.1.26 2023-09-14 07:01:02,591 INFO [Listener at jenkins-hbase4.apache.org/33915] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_35837_cluster____xg1vu2/webapp 2023-09-14 07:01:02,661 INFO [Listener at jenkins-hbase4.apache.org/33915] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-09-14 07:01:02,661 INFO [Listener at jenkins-hbase4.apache.org/33915] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-09-14 07:01:02,661 INFO [Listener at jenkins-hbase4.apache.org/33915] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-14 07:01:02,662 INFO [Listener at jenkins-hbase4.apache.org/33915] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-14 07:01:02,672 INFO [Listener at jenkins-hbase4.apache.org/33915] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-14 07:01:02,900 INFO [Listener at jenkins-hbase4.apache.org/33915] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-14 07:01:03,023 INFO [Listener at jenkins-hbase4.apache.org/33915] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-14 07:01:03,032 INFO [Listener at jenkins-hbase4.apache.org/33915] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:35837 2023-09-14 07:01:03,559 WARN [Listener at jenkins-hbase4.apache.org/38045] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-14 07:01:03,586 WARN [Listener at jenkins-hbase4.apache.org/38045] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-14 07:01:03,587 INFO [Listener at jenkins-hbase4.apache.org/38045] log.Slf4jLog(67): jetty-6.1.26 2023-09-14 07:01:03,593 INFO [Listener at jenkins-hbase4.apache.org/38045] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_43973_node____sijf3o/webapp 2023-09-14 07:01:03,674 INFO [Listener at jenkins-hbase4.apache.org/38045] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-14 07:01:03,674 INFO [Listener at jenkins-hbase4.apache.org/38045] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-14 07:01:03,674 INFO [Listener at jenkins-hbase4.apache.org/38045] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-14 07:01:03,674 INFO [Listener at jenkins-hbase4.apache.org/38045] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-14 07:01:03,684 INFO [Listener at jenkins-hbase4.apache.org/38045] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-14 07:01:03,706 INFO [Listener at jenkins-hbase4.apache.org/38045] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-14 07:01:03,808 INFO [Listener at jenkins-hbase4.apache.org/38045] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-14 07:01:03,821 INFO [Listener at jenkins-hbase4.apache.org/38045] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:43973 2023-09-14 07:01:04,011 WARN [Listener at jenkins-hbase4.apache.org/40843] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-14 07:01:04,017 WARN [Listener at jenkins-hbase4.apache.org/40843] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-14 07:01:04,017 INFO [Listener at jenkins-hbase4.apache.org/40843] log.Slf4jLog(67): jetty-6.1.26 2023-09-14 07:01:04,024 INFO [Listener at jenkins-hbase4.apache.org/40843] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_46343_node____9vwne6/webapp 2023-09-14 07:01:04,075 INFO [Listener at jenkins-hbase4.apache.org/40843] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-14 07:01:04,075 INFO [Listener at jenkins-hbase4.apache.org/40843] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-14 07:01:04,076 INFO [Listener at jenkins-hbase4.apache.org/40843] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-14 07:01:04,076 INFO [Listener at jenkins-hbase4.apache.org/40843] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-14 07:01:04,085 INFO [Listener at jenkins-hbase4.apache.org/40843] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-14 07:01:04,098 INFO [Listener at jenkins-hbase4.apache.org/40843] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-14 07:01:04,154 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-14 07:01:04,173 INFO [Listener at jenkins-hbase4.apache.org/40843] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-14 07:01:04,183 INFO [Listener at jenkins-hbase4.apache.org/40843] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:46343 2023-09-14 07:01:04,236 INFO [Listener at jenkins-hbase4.apache.org/40843] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-09-14 07:01:04,239 INFO [Listener at jenkins-hbase4.apache.org/40843] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-09-14 07:01:04,324 INFO [Listener at jenkins-hbase4.apache.org/40843] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=708, OpenFileDescriptor=899, MaxFileDescriptor=60000, SystemLoadAverage=118, ProcessCount=163, AvailableMemoryMB=9535 2023-09-14 07:01:04,324 WARN [Listener at jenkins-hbase4.apache.org/40843] hbase.ResourceChecker(130): Thread=708 is superior to 500 2023-09-14 07:01:04,340 DEBUG [Listener at jenkins-hbase4.apache.org/40843] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-09-14 07:01:04,351 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47458, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-09-14 07:01:04,359 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-14 07:01:04,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-09-14 07:01:04,372 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-09-14 07:01:04,373 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-09-14 07:01:04,375 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-14 07:01:04,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-14 07:01:04,381 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportWithTargetName/8909056e4588270f82eeb3121d081bf6 2023-09-14 07:01:04,381 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportWithTargetName/cf98c44fd4e3647e59978712a1b34160 2023-09-14 07:01:04,382 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportWithTargetName/cf98c44fd4e3647e59978712a1b34160 empty. 2023-09-14 07:01:04,383 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportWithTargetName/8909056e4588270f82eeb3121d081bf6 empty. 2023-09-14 07:01:04,384 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportWithTargetName/cf98c44fd4e3647e59978712a1b34160 2023-09-14 07:01:04,389 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportWithTargetName/8909056e4588270f82eeb3121d081bf6 2023-09-14 07:01:04,390 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-14 07:01:04,398 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-09-14 07:01:04,400 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-09-14 07:01:04,401 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-09-14 07:01:04,426 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-09-14 07:01:04,428 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8909056e4588270f82eeb3121d081bf6, NAME => 'testtb-testExportWithTargetName,,1694674864358.8909056e4588270f82eeb3121d081bf6.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp 2023-09-14 07:01:04,428 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => cf98c44fd4e3647e59978712a1b34160, NAME => 'testtb-testExportWithTargetName,1,1694674864358.cf98c44fd4e3647e59978712a1b34160.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp 2023-09-14 07:01:04,461 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1694674864358.cf98c44fd4e3647e59978712a1b34160.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 07:01:04,461 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing cf98c44fd4e3647e59978712a1b34160, disabling compactions & flushes 2023-09-14 07:01:04,461 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1694674864358.cf98c44fd4e3647e59978712a1b34160. 2023-09-14 07:01:04,461 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1694674864358.cf98c44fd4e3647e59978712a1b34160. 2023-09-14 07:01:04,461 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1694674864358.cf98c44fd4e3647e59978712a1b34160. after waiting 0 ms 2023-09-14 07:01:04,461 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1694674864358.cf98c44fd4e3647e59978712a1b34160. 2023-09-14 07:01:04,461 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1694674864358.cf98c44fd4e3647e59978712a1b34160. 2023-09-14 07:01:04,461 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for cf98c44fd4e3647e59978712a1b34160: 2023-09-14 07:01:04,463 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1694674864358.8909056e4588270f82eeb3121d081bf6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 07:01:04,464 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 8909056e4588270f82eeb3121d081bf6, disabling compactions & flushes 2023-09-14 07:01:04,464 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1694674864358.8909056e4588270f82eeb3121d081bf6. 2023-09-14 07:01:04,464 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1694674864358.8909056e4588270f82eeb3121d081bf6. 2023-09-14 07:01:04,464 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1694674864358.8909056e4588270f82eeb3121d081bf6. after waiting 0 ms 2023-09-14 07:01:04,464 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1694674864358.8909056e4588270f82eeb3121d081bf6. 2023-09-14 07:01:04,464 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1694674864358.8909056e4588270f82eeb3121d081bf6. 2023-09-14 07:01:04,464 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 8909056e4588270f82eeb3121d081bf6: 2023-09-14 07:01:04,468 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-09-14 07:01:04,470 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1694674864358.cf98c44fd4e3647e59978712a1b34160.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694674864470"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694674864470"}]},"ts":"1694674864470"} 2023-09-14 07:01:04,470 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1694674864358.8909056e4588270f82eeb3121d081bf6.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694674864470"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694674864470"}]},"ts":"1694674864470"} 2023-09-14 07:01:04,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-14 07:01:04,517 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-14 07:01:04,519 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-14 07:01:04,519 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694674864519"}]},"ts":"1694674864519"} 2023-09-14 07:01:04,521 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-09-14 07:01:04,527 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-14 07:01:04,529 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-14 07:01:04,529 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-14 07:01:04,529 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-14 07:01:04,529 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-14 07:01:04,530 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8909056e4588270f82eeb3121d081bf6, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cf98c44fd4e3647e59978712a1b34160, ASSIGN}] 2023-09-14 07:01:04,533 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cf98c44fd4e3647e59978712a1b34160, ASSIGN 2023-09-14 07:01:04,533 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8909056e4588270f82eeb3121d081bf6, ASSIGN 2023-09-14 07:01:04,534 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cf98c44fd4e3647e59978712a1b34160, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41005,1694674856735; forceNewPlan=false, retain=false 2023-09-14 07:01:04,534 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8909056e4588270f82eeb3121d081bf6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35941,1694674856649; forceNewPlan=false, retain=false 2023-09-14 07:01:04,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-14 07:01:04,684 INFO [jenkins-hbase4:33055] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-14 07:01:04,687 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=cf98c44fd4e3647e59978712a1b34160, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:04,687 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=8909056e4588270f82eeb3121d081bf6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:04,688 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1694674864358.cf98c44fd4e3647e59978712a1b34160.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694674864687"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694674864687"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694674864687"}]},"ts":"1694674864687"} 2023-09-14 07:01:04,688 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1694674864358.8909056e4588270f82eeb3121d081bf6.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694674864687"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694674864687"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694674864687"}]},"ts":"1694674864687"} 2023-09-14 07:01:04,691 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure cf98c44fd4e3647e59978712a1b34160, server=jenkins-hbase4.apache.org,41005,1694674856735}] 2023-09-14 07:01:04,693 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 8909056e4588270f82eeb3121d081bf6, server=jenkins-hbase4.apache.org,35941,1694674856649}] 2023-09-14 07:01:04,852 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1694674864358.cf98c44fd4e3647e59978712a1b34160. 2023-09-14 07:01:04,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cf98c44fd4e3647e59978712a1b34160, NAME => 'testtb-testExportWithTargetName,1,1694674864358.cf98c44fd4e3647e59978712a1b34160.', STARTKEY => '1', ENDKEY => ''} 2023-09-14 07:01:04,853 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1694674864358.8909056e4588270f82eeb3121d081bf6. 2023-09-14 07:01:04,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8909056e4588270f82eeb3121d081bf6, NAME => 'testtb-testExportWithTargetName,,1694674864358.8909056e4588270f82eeb3121d081bf6.', STARTKEY => '', ENDKEY => '1'} 2023-09-14 07:01:04,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1694674864358.cf98c44fd4e3647e59978712a1b34160. service=AccessControlService 2023-09-14 07:01:04,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1694674864358.8909056e4588270f82eeb3121d081bf6. service=AccessControlService 2023-09-14 07:01:04,853 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-14 07:01:04,853 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-14 07:01:04,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName cf98c44fd4e3647e59978712a1b34160 2023-09-14 07:01:04,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 8909056e4588270f82eeb3121d081bf6 2023-09-14 07:01:04,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1694674864358.cf98c44fd4e3647e59978712a1b34160.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 07:01:04,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1694674864358.8909056e4588270f82eeb3121d081bf6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 07:01:04,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cf98c44fd4e3647e59978712a1b34160 2023-09-14 07:01:04,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8909056e4588270f82eeb3121d081bf6 2023-09-14 07:01:04,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cf98c44fd4e3647e59978712a1b34160 2023-09-14 07:01:04,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8909056e4588270f82eeb3121d081bf6 2023-09-14 07:01:04,857 INFO [StoreOpener-8909056e4588270f82eeb3121d081bf6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8909056e4588270f82eeb3121d081bf6 2023-09-14 07:01:04,857 INFO [StoreOpener-cf98c44fd4e3647e59978712a1b34160-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region cf98c44fd4e3647e59978712a1b34160 2023-09-14 07:01:04,859 DEBUG [StoreOpener-8909056e4588270f82eeb3121d081bf6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportWithTargetName/8909056e4588270f82eeb3121d081bf6/cf 2023-09-14 07:01:04,859 DEBUG [StoreOpener-8909056e4588270f82eeb3121d081bf6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportWithTargetName/8909056e4588270f82eeb3121d081bf6/cf 2023-09-14 07:01:04,859 DEBUG [StoreOpener-cf98c44fd4e3647e59978712a1b34160-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportWithTargetName/cf98c44fd4e3647e59978712a1b34160/cf 2023-09-14 07:01:04,860 DEBUG [StoreOpener-cf98c44fd4e3647e59978712a1b34160-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportWithTargetName/cf98c44fd4e3647e59978712a1b34160/cf 2023-09-14 07:01:04,863 INFO [StoreOpener-8909056e4588270f82eeb3121d081bf6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8909056e4588270f82eeb3121d081bf6 columnFamilyName cf 2023-09-14 07:01:04,863 INFO [StoreOpener-cf98c44fd4e3647e59978712a1b34160-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cf98c44fd4e3647e59978712a1b34160 columnFamilyName cf 2023-09-14 07:01:04,870 INFO [StoreOpener-8909056e4588270f82eeb3121d081bf6-1] regionserver.HStore(310): Store=8909056e4588270f82eeb3121d081bf6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-14 07:01:04,870 INFO [StoreOpener-cf98c44fd4e3647e59978712a1b34160-1] regionserver.HStore(310): Store=cf98c44fd4e3647e59978712a1b34160/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-14 07:01:04,874 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportWithTargetName/8909056e4588270f82eeb3121d081bf6 2023-09-14 07:01:04,874 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportWithTargetName/cf98c44fd4e3647e59978712a1b34160 2023-09-14 07:01:04,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportWithTargetName/8909056e4588270f82eeb3121d081bf6 2023-09-14 07:01:04,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportWithTargetName/cf98c44fd4e3647e59978712a1b34160 2023-09-14 07:01:04,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8909056e4588270f82eeb3121d081bf6 2023-09-14 07:01:04,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cf98c44fd4e3647e59978712a1b34160 2023-09-14 07:01:04,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportWithTargetName/8909056e4588270f82eeb3121d081bf6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-14 07:01:04,898 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8909056e4588270f82eeb3121d081bf6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66080454, jitterRate=-0.015324503183364868}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-14 07:01:04,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportWithTargetName/cf98c44fd4e3647e59978712a1b34160/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-14 07:01:04,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8909056e4588270f82eeb3121d081bf6: 2023-09-14 07:01:04,900 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cf98c44fd4e3647e59978712a1b34160; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66147156, jitterRate=-0.014330565929412842}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-14 07:01:04,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cf98c44fd4e3647e59978712a1b34160: 2023-09-14 07:01:04,901 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1694674864358.8909056e4588270f82eeb3121d081bf6., pid=16, masterSystemTime=1694674864847 2023-09-14 07:01:04,901 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1694674864358.cf98c44fd4e3647e59978712a1b34160., pid=15, masterSystemTime=1694674864845 2023-09-14 07:01:04,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1694674864358.8909056e4588270f82eeb3121d081bf6. 2023-09-14 07:01:04,904 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1694674864358.8909056e4588270f82eeb3121d081bf6. 2023-09-14 07:01:04,905 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=8909056e4588270f82eeb3121d081bf6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:04,905 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1694674864358.8909056e4588270f82eeb3121d081bf6.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694674864904"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694674864904"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694674864904"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694674864904"}]},"ts":"1694674864904"} 2023-09-14 07:01:04,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1694674864358.cf98c44fd4e3647e59978712a1b34160. 2023-09-14 07:01:04,905 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1694674864358.cf98c44fd4e3647e59978712a1b34160. 2023-09-14 07:01:04,906 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=cf98c44fd4e3647e59978712a1b34160, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:04,908 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1694674864358.cf98c44fd4e3647e59978712a1b34160.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694674864906"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694674864906"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694674864906"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694674864906"}]},"ts":"1694674864906"} 2023-09-14 07:01:04,913 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=13 2023-09-14 07:01:04,913 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 8909056e4588270f82eeb3121d081bf6, server=jenkins-hbase4.apache.org,35941,1694674856649 in 216 msec 2023-09-14 07:01:04,916 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=14 2023-09-14 07:01:04,917 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure cf98c44fd4e3647e59978712a1b34160, server=jenkins-hbase4.apache.org,41005,1694674856735 in 220 msec 2023-09-14 07:01:04,918 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8909056e4588270f82eeb3121d081bf6, ASSIGN in 383 msec 2023-09-14 07:01:04,921 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=14, resume processing ppid=12 2023-09-14 07:01:04,921 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cf98c44fd4e3647e59978712a1b34160, ASSIGN in 388 msec 2023-09-14 07:01:04,922 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-14 07:01:04,922 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694674864922"}]},"ts":"1694674864922"} 2023-09-14 07:01:04,924 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-09-14 07:01:04,927 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-09-14 07:01:04,932 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-09-14 07:01:04,939 DEBUG [PEWorker-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 07:01:04,942 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43090, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 07:01:04,947 DEBUG [hconnection-0x744f24d2-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 07:01:04,949 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45344, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=ClientService 2023-09-14 07:01:04,957 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35941] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-14 07:01:04,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-14 07:01:04,989 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-14 07:01:04,989 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-14 07:01:04,989 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-14 07:01:04,989 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-14 07:01:04,989 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-14 07:01:04,996 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-14 07:01:04,996 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-14 07:01:04,996 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-14 07:01:04,996 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-14 07:01:04,997 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-14 07:01:05,000 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 638 msec 2023-09-14 07:01:05,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-14 07:01:05,487 INFO [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-09-14 07:01:05,492 DEBUG [Listener at jenkins-hbase4.apache.org/40843] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-14 07:01:05,493 DEBUG [Listener at jenkins-hbase4.apache.org/40843] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1694674864358.8909056e4588270f82eeb3121d081bf6. 2023-09-14 07:01:05,495 INFO [Listener at jenkins-hbase4.apache.org/40843] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-14 07:01:05,521 DEBUG [hconnection-0x38d5a78c-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 07:01:05,525 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54826, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 07:01:05,528 DEBUG [hconnection-0x38d5a78c-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 07:01:05,532 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52336, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 07:01:05,546 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-14 07:01:05,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694674865546 (current time:1694674865546). 2023-09-14 07:01:05,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-14 07:01:05,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] zookeeper.ReadOnlyZKClient(139): Connect 0x13c4bb30 to 127.0.0.1:52295 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 07:01:05,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@28c4f529, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 07:01:05,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 07:01:05,559 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36264, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 07:01:05,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x13c4bb30 to 127.0.0.1:52295 2023-09-14 07:01:05,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 07:01:05,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] zookeeper.ReadOnlyZKClient(139): Connect 0x008f9839 to 127.0.0.1:52295 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 07:01:05,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d99932c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 07:01:05,570 DEBUG [hconnection-0x796f78c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 07:01:05,572 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36276, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 07:01:05,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 07:01:05,578 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54838, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 07:01:05,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x008f9839 to 127.0.0.1:52295 2023-09-14 07:01:05,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 07:01:05,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-14 07:01:05,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-14 07:01:05,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-14 07:01:05,616 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-14 07:01:05,617 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-09-14 07:01:05,617 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-14 07:01:05,617 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-09-14 07:01:05,618 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-14 07:01:05,618 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-09-14 07:01:05,618 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-14 07:01:05,618 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-09-14 07:01:05,618 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-14 07:01:05,618 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-09-14 07:01:05,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-14 07:01:05,630 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-14 07:01:05,632 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1694675465632 2023-09-14 07:01:05,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-14 07:01:05,632 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-14 07:01:05,635 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-14 07:01:05,636 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-14 07:01:05,637 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 16 msec 2023-09-14 07:01:05,638 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-14 07:01:05,639 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1694675465639 2023-09-14 07:01:05,640 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-14 07:01:05,640 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-14 07:01:05,679 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,679 INFO [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-09-14 07:01:05,680 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 07:01:05,681 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-09-14 07:01:05,681 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-14 07:01:05,681 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,681 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,688 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:01:05,688 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:01:05,688 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:01:05,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:01:05,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:01:05,688 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:05,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:01:05,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:01:05,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:01:05,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:01:05,688 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:05,688 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:05,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,689 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,689 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:05,689 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,689 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-14 07:01:05,689 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-14 07:01:05,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-14 07:01:05,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-14 07:01:05,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,690 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-14 07:01:05,690 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-14 07:01:05,691 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-14 07:01:05,696 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,696 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,696 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,696 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-14 07:01:05,697 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 07:01:05,697 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-14 07:01:05,697 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-14 07:01:05,697 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-14 07:01:05,697 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-14 07:01:05,697 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 07:01:05,698 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35941,1694674856649' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-14 07:01:05,698 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-14 07:01:05,698 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-14 07:01:05,698 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37703,1694674856695' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-14 07:01:05,697 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 07:01:05,699 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-14 07:01:05,699 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-14 07:01:05,699 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41005,1694674856735' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-14 07:01:05,701 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,702 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:05,702 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,702 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:05,702 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,702 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:05,703 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 07:01:05,702 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,702 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,703 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 07:01:05,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:01:05,703 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 07:01:05,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:01:05,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:01:05,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:01:05,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:05,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:05,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:05,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:01:05,706 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35941,1694674856649' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-14 07:01:05,706 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2396f5f7[Count = 1] remaining members to acquire global barrier 2023-09-14 07:01:05,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:05,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:01:05,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:01:05,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:01:05,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:01:05,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:05,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:05,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:05,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:01:05,709 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41005,1694674856735' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-14 07:01:05,709 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2396f5f7[Count = 0] remaining members to acquire global barrier 2023-09-14 07:01:05,709 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-14 07:01:05,709 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,711 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,711 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,711 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,711 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-14 07:01:05,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,711 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:05,711 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-14 07:01:05,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,712 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-14 07:01:05,712 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-14 07:01:05,712 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37703,1694674856695' in zk 2023-09-14 07:01:05,712 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:05,712 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-14 07:01:05,713 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-14 07:01:05,713 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-14 07:01:05,713 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1694674864358.8909056e4588270f82eeb3121d081bf6. 2023-09-14 07:01:05,713 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1694674864358.8909056e4588270f82eeb3121d081bf6. started... 2023-09-14 07:01:05,716 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8909056e4588270f82eeb3121d081bf6: 2023-09-14 07:01:05,718 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-14 07:01:05,718 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1694674864358.cf98c44fd4e3647e59978712a1b34160. 2023-09-14 07:01:05,718 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1694674864358.cf98c44fd4e3647e59978712a1b34160. started... 2023-09-14 07:01:05,718 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-14 07:01:05,718 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1694674864358.8909056e4588270f82eeb3121d081bf6.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,719 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cf98c44fd4e3647e59978712a1b34160: 2023-09-14 07:01:05,718 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-14 07:01:05,719 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 07:01:05,719 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-14 07:01:05,719 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1694674864358.cf98c44fd4e3647e59978712a1b34160.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,725 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-14 07:01:05,725 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-14 07:01:05,729 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-14 07:01:05,729 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-14 07:01:05,740 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-14 07:01:05,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-14 07:01:05,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-14 07:01:05,745 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-14 07:01:05,771 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1694674864358.8909056e4588270f82eeb3121d081bf6. completed. 2023-09-14 07:01:05,771 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1694674864358.8909056e4588270f82eeb3121d081bf6. 2023-09-14 07:01:05,774 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-14 07:01:05,774 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-14 07:01:05,774 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:05,775 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-14 07:01:05,775 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35941,1694674856649' in zk 2023-09-14 07:01:05,778 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:05,778 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-14 07:01:05,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:05,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:01:05,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:01:05,778 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 07:01:05,778 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-14 07:01:05,780 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1694674864358.cf98c44fd4e3647e59978712a1b34160. completed. 2023-09-14 07:01:05,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:01:05,780 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1694674864358.cf98c44fd4e3647e59978712a1b34160. 2023-09-14 07:01:05,780 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-14 07:01:05,780 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-14 07:01:05,780 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:05,780 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-14 07:01:05,780 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,41005,1694674856735' in zk 2023-09-14 07:01:05,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:01:05,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,782 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-14 07:01:05,782 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:05,782 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 07:01:05,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:05,782 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-14 07:01:05,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:05,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:05,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:01:05,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:05,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:05,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:05,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,35941,1694674856649': 2023-09-14 07:01:05,786 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35941,1694674856649' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-14 07:01:05,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:05,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:01:05,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:01:05,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:01:05,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:01:05,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:05,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:05,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:05,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:01:05,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:05,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:05,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:05,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,41005,1694674856735': 2023-09-14 07:01:05,790 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41005,1694674856735' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-14 07:01:05,790 INFO [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-09-14 07:01:05,790 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-14 07:01:05,790 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-14 07:01:05,790 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,790 INFO [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-14 07:01:05,793 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,793 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:01:05,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:01:05,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,793 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,793 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:01:05,793 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,793 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:01:05,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,793 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:01:05,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:01:05,794 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:05,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:01:05,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:01:05,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:01:05,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:01:05,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:01:05,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:01:05,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,794 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:05,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:01:05,795 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:05,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:05,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:05,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:05,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:01:05,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,797 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:05,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:05,798 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:05,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:05,798 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:05,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:05,813 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:01:05,813 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:01:05,813 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:01:05,813 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:05,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:01:05,813 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,813 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 07:01:05,813 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:05,813 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:01:05,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:01:05,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:01:05,813 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:01:05,813 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:01:05,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:01:05,814 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:05,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:01:05,814 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,813 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,814 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:05,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:01:05,814 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-14 07:01:05,814 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,815 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:05,815 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:05,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:01:05,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:01:05,815 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,815 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:01:05,815 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-14 07:01:05,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:01:05,815 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:01:05,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:01:05,816 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-14 07:01:05,836 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,839 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,890 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,891 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-14 07:01:05,891 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,892 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:05,892 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1694674865632Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1694674865836 (+204 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1694674865836Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1694674865836Writing data manifest for emptySnaptb0-testExportWithTargetName at 1694674865851 (+15 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1694674865879 (+28 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1694674865891 (+12 ms) 2023-09-14 07:01:05,894 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-14 07:01:05,897 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 260 msec 2023-09-14 07:01:05,945 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-14 07:01:05,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-14 07:01:05,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-14 07:01:05,968 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35941] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1694674864358.8909056e4588270f82eeb3121d081bf6. with WAL disabled. Data may be lost in the event of a crash. 2023-09-14 07:01:05,971 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41005] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1694674864358.cf98c44fd4e3647e59978712a1b34160. with WAL disabled. Data may be lost in the event of a crash. 2023-09-14 07:01:05,976 DEBUG [Listener at jenkins-hbase4.apache.org/40843] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-14 07:01:05,977 DEBUG [Listener at jenkins-hbase4.apache.org/40843] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1694674864358.8909056e4588270f82eeb3121d081bf6. 2023-09-14 07:01:05,977 INFO [Listener at jenkins-hbase4.apache.org/40843] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-14 07:01:05,992 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-14 07:01:05,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694674865993 (current time:1694674865993). 2023-09-14 07:01:05,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-14 07:01:05,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] zookeeper.ReadOnlyZKClient(139): Connect 0x13d254a4 to 127.0.0.1:52295 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 07:01:06,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d791405, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 07:01:06,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 07:01:06,005 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36280, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 07:01:06,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x13d254a4 to 127.0.0.1:52295 2023-09-14 07:01:06,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 07:01:06,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] zookeeper.ReadOnlyZKClient(139): Connect 0x5ddd754f to 127.0.0.1:52295 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 07:01:06,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5cab7d24, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 07:01:06,014 DEBUG [hconnection-0x9279388-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 07:01:06,016 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36288, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 07:01:06,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 07:01:06,025 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54850, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 07:01:06,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5ddd754f to 127.0.0.1:52295 2023-09-14 07:01:06,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 07:01:06,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-14 07:01:06,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-14 07:01:06,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-14 07:01:06,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-14 07:01:06,032 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-14 07:01:06,033 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1694675466033 2023-09-14 07:01:06,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-14 07:01:06,033 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-14 07:01:06,035 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-14 07:01:06,035 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-14 07:01:06,036 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-14 07:01:06,037 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-14 07:01:06,039 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-09-14 07:01:06,040 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-14 07:01:06,041 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1694675466041 2023-09-14 07:01:06,061 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-09-14 07:01:06,061 INFO [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-09-14 07:01:06,061 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 07:01:06,062 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-09-14 07:01:06,062 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-14 07:01:06,062 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-14 07:01:06,062 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-14 07:01:06,064 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:01:06,064 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:01:06,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:01:06,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:01:06,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:01:06,064 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:06,064 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:01:06,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:01:06,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:01:06,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:01:06,065 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:06,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-14 07:01:06,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-14 07:01:06,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-14 07:01:06,065 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:06,065 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-14 07:01:06,065 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-14 07:01:06,065 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-14 07:01:06,065 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:06,065 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-14 07:01:06,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-14 07:01:06,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-14 07:01:06,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-14 07:01:06,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-14 07:01:06,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-14 07:01:06,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-14 07:01:06,066 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-14 07:01:06,066 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-14 07:01:06,066 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-14 07:01:06,066 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-14 07:01:06,066 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-14 07:01:06,066 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-14 07:01:06,066 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 07:01:06,069 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-14 07:01:06,070 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-14 07:01:06,070 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-14 07:01:06,070 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41005,1694674856735' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-14 07:01:06,066 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-14 07:01:06,070 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 07:01:06,070 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-14 07:01:06,071 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-14 07:01:06,071 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-14 07:01:06,071 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35941,1694674856649' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-14 07:01:06,071 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 07:01:06,072 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-14 07:01:06,072 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-14 07:01:06,072 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37703,1694674856695' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-14 07:01:06,074 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:06,074 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-14 07:01:06,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:06,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:01:06,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:01:06,075 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:06,075 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-14 07:01:06,075 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 07:01:06,075 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-14 07:01:06,077 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-14 07:01:06,077 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-14 07:01:06,077 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 07:01:06,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:01:06,077 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-14 07:01:06,077 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 07:01:06,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:01:06,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-14 07:01:06,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:06,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:06,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:06,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:01:06,079 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41005,1694674856735' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-14 07:01:06,079 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e1166c0[Count = 1] remaining members to acquire global barrier 2023-09-14 07:01:06,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:06,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:01:06,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:01:06,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:01:06,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:01:06,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-14 07:01:06,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:06,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:06,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:06,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:01:06,081 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35941,1694674856649' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-14 07:01:06,082 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e1166c0[Count = 0] remaining members to acquire global barrier 2023-09-14 07:01:06,082 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-14 07:01:06,082 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-14 07:01:06,086 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-14 07:01:06,086 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-14 07:01:06,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-14 07:01:06,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-14 07:01:06,086 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-14 07:01:06,087 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-14 07:01:06,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-14 07:01:06,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-14 07:01:06,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-14 07:01:06,087 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-14 07:01:06,087 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-14 07:01:06,087 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1694674864358.8909056e4588270f82eeb3121d081bf6. 2023-09-14 07:01:06,087 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-14 07:01:06,087 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:06,087 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1694674864358.8909056e4588270f82eeb3121d081bf6. started... 2023-09-14 07:01:06,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-14 07:01:06,087 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-14 07:01:06,087 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1694674864358.cf98c44fd4e3647e59978712a1b34160. 2023-09-14 07:01:06,087 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-14 07:01:06,087 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1694674864358.cf98c44fd4e3647e59978712a1b34160. started... 2023-09-14 07:01:06,087 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:06,087 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-14 07:01:06,087 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-14 07:01:06,087 INFO [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8909056e4588270f82eeb3121d081bf6 1/1 column families, dataSize=132 B heapSize=544 B 2023-09-14 07:01:06,088 INFO [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] regionserver.HRegion(2745): Flushing cf98c44fd4e3647e59978712a1b34160 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-09-14 07:01:06,088 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-14 07:01:06,088 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37703,1694674856695' in zk 2023-09-14 07:01:06,090 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-14 07:01:06,090 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 07:01:06,090 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-14 07:01:06,136 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-14 07:01:06,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-14 07:01:06,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-14 07:01:06,138 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-14 07:01:06,238 INFO [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230914c31edff529b34af48e4502773d1b018d to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230914c31edff529b34af48e4502773d1b018d 2023-09-14 07:01:06,238 INFO [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023091424241068a97c4f4da2feea2d039c0d07 to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023091424241068a97c4f4da2feea2d039c0d07 2023-09-14 07:01:06,276 INFO [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportWithTargetName/cf98c44fd4e3647e59978712a1b34160/.tmp/cf/016c2676014c4a0aa167e5509b27ada0 2023-09-14 07:01:06,278 INFO [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportWithTargetName/8909056e4588270f82eeb3121d081bf6/.tmp/cf/56affc01f0e944efb0c0719d1637752d 2023-09-14 07:01:06,290 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportWithTargetName/8909056e4588270f82eeb3121d081bf6/.tmp/cf/56affc01f0e944efb0c0719d1637752d as hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportWithTargetName/8909056e4588270f82eeb3121d081bf6/cf/56affc01f0e944efb0c0719d1637752d 2023-09-14 07:01:06,290 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportWithTargetName/cf98c44fd4e3647e59978712a1b34160/.tmp/cf/016c2676014c4a0aa167e5509b27ada0 as hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportWithTargetName/cf98c44fd4e3647e59978712a1b34160/cf/016c2676014c4a0aa167e5509b27ada0 2023-09-14 07:01:06,300 INFO [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportWithTargetName/8909056e4588270f82eeb3121d081bf6/cf/56affc01f0e944efb0c0719d1637752d, entries=2, sequenceid=6, filesize=5.2 K 2023-09-14 07:01:06,302 INFO [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportWithTargetName/cf98c44fd4e3647e59978712a1b34160/cf/016c2676014c4a0aa167e5509b27ada0, entries=48, sequenceid=6, filesize=13.0 K 2023-09-14 07:01:06,306 INFO [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 8909056e4588270f82eeb3121d081bf6 in 219ms, sequenceid=6, compaction requested=false 2023-09-14 07:01:06,306 INFO [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for cf98c44fd4e3647e59978712a1b34160 in 218ms, sequenceid=6, compaction requested=false 2023-09-14 07:01:06,306 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-14 07:01:06,306 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-14 07:01:06,309 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cf98c44fd4e3647e59978712a1b34160: 2023-09-14 07:01:06,309 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8909056e4588270f82eeb3121d081bf6: 2023-09-14 07:01:06,309 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1694674864358.8909056e4588270f82eeb3121d081bf6.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-14 07:01:06,309 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1694674864358.cf98c44fd4e3647e59978712a1b34160.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-14 07:01:06,309 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-14 07:01:06,309 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-14 07:01:06,310 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportWithTargetName/cf98c44fd4e3647e59978712a1b34160/cf/016c2676014c4a0aa167e5509b27ada0] hfiles 2023-09-14 07:01:06,310 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportWithTargetName/8909056e4588270f82eeb3121d081bf6/cf/56affc01f0e944efb0c0719d1637752d] hfiles 2023-09-14 07:01:06,310 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportWithTargetName/cf98c44fd4e3647e59978712a1b34160/cf/016c2676014c4a0aa167e5509b27ada0 for snapshot=snaptb0-testExportWithTargetName 2023-09-14 07:01:06,310 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportWithTargetName/8909056e4588270f82eeb3121d081bf6/cf/56affc01f0e944efb0c0719d1637752d for snapshot=snaptb0-testExportWithTargetName 2023-09-14 07:01:06,335 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1694674864358.8909056e4588270f82eeb3121d081bf6. completed. 2023-09-14 07:01:06,335 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1694674864358.8909056e4588270f82eeb3121d081bf6. 2023-09-14 07:01:06,335 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-14 07:01:06,335 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-14 07:01:06,335 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:06,335 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-14 07:01:06,335 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35941,1694674856649' in zk 2023-09-14 07:01:06,335 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1694674864358.cf98c44fd4e3647e59978712a1b34160. completed. 2023-09-14 07:01:06,335 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1694674864358.cf98c44fd4e3647e59978712a1b34160. 2023-09-14 07:01:06,336 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-14 07:01:06,336 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-14 07:01:06,336 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:06,336 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-14 07:01:06,336 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,41005,1694674856735' in zk 2023-09-14 07:01:06,338 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-14 07:01:06,338 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:06,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:06,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:01:06,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:01:06,338 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-14 07:01:06,338 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 07:01:06,338 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-14 07:01:06,340 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-14 07:01:06,340 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:06,340 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 07:01:06,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:01:06,340 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-14 07:01:06,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:01:06,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-14 07:01:06,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:06,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:06,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:06,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:01:06,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-14 07:01:06,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:06,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:06,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:06,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,35941,1694674856649': 2023-09-14 07:01:06,345 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35941,1694674856649' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-14 07:01:06,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:06,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:01:06,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:01:06,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-14 07:01:06,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-14 07:01:06,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:01:06,346 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-14 07:01:06,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:01:06,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-14 07:01:06,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:06,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:06,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:06,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:01:06,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-14 07:01:06,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:06,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:06,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:06,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,41005,1694674856735': 2023-09-14 07:01:06,350 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41005,1694674856735' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-14 07:01:06,350 INFO [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-09-14 07:01:06,350 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-14 07:01:06,350 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-14 07:01:06,350 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-09-14 07:01:06,350 INFO [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-14 07:01:06,352 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-14 07:01:06,352 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-14 07:01:06,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-14 07:01:06,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-14 07:01:06,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:01:06,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:01:06,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-14 07:01:06,352 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:01:06,352 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-14 07:01:06,353 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:01:06,353 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-14 07:01:06,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-14 07:01:06,353 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:01:06,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-14 07:01:06,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-14 07:01:06,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:01:06,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:01:06,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:01:06,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-14 07:01:06,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:01:06,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:01:06,354 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:06,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-14 07:01:06,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:01:06,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:01:06,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-14 07:01:06,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-14 07:01:06,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-14 07:01:06,357 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:06,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:01:06,357 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:06,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-14 07:01:06,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:06,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:06,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:06,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:01:06,360 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:06,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-14 07:01:06,360 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:06,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:06,361 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:06,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:06,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:06,375 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:01:06,375 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:01:06,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:01:06,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:01:06,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:01:06,375 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:01:06,375 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:01:06,375 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:01:06,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:01:06,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:01:06,375 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:06,375 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-09-14 07:01:06,375 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 07:01:06,376 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:01:06,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:01:06,376 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-14 07:01:06,376 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-14 07:01:06,377 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:06,377 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-14 07:01:06,377 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:06,377 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-14 07:01:06,377 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-14 07:01:06,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:01:06,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:01:06,377 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:06,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:01:06,377 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-14 07:01:06,378 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:06,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:01:06,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:01:06,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:01:06,378 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:06,378 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-14 07:01:06,378 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-14 07:01:06,379 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230914c31edff529b34af48e4502773d1b018d, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023091424241068a97c4f4da2feea2d039c0d07] mob files 2023-09-14 07:01:06,379 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230914c31edff529b34af48e4502773d1b018d 2023-09-14 07:01:06,379 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023091424241068a97c4f4da2feea2d039c0d07 2023-09-14 07:01:06,392 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-09-14 07:01:06,394 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-14 07:01:06,432 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-14 07:01:06,433 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-14 07:01:06,433 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-14 07:01:06,434 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-14 07:01:06,434 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1694674866033Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1694674866392 (+359 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1694674866392Loading Region manifests for snaptb0-testExportWithTargetName at 1694674866393 (+1 ms)Writing data manifest for snaptb0-testExportWithTargetName at 1694674866398 (+5 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1694674866420 (+22 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1694674866433 (+13 ms) 2023-09-14 07:01:06,436 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-14 07:01:06,438 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 402 msec 2023-09-14 07:01:06,646 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-14 07:01:06,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-14 07:01:06,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-14 07:01:06,649 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/export-test/export-1694674866649 2023-09-14 07:01:06,650 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44283, tgtDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/export-test/export-1694674866649, rawTgtDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/export-test/export-1694674866649, srcFsUri=hdfs://localhost:44283, srcDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04 2023-09-14 07:01:06,692 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44283, inputRoot=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04 2023-09-14 07:01:06,692 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_454975469_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/export-test/export-1694674866649, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/export-test/export-1694674866649/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-14 07:01:06,692 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44283, inputRoot=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04, snapshotDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-09-14 07:01:06,711 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/export-test/export-1694674866649/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-14 07:01:06,790 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-14 07:01:06,790 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-14 07:01:06,791 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-14 07:01:06,791 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-14 07:01:07,734 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/hadoop-864710446290606818.jar 2023-09-14 07:01:07,735 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-14 07:01:07,736 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-14 07:01:07,807 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/hadoop-480548370408201254.jar 2023-09-14 07:01:07,808 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-14 07:01:07,809 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-14 07:01:07,809 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-14 07:01:07,810 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-14 07:01:07,810 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-14 07:01:07,811 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-14 07:01:07,811 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-14 07:01:07,812 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-14 07:01:07,812 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-14 07:01:07,813 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-14 07:01:07,813 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-14 07:01:07,814 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-14 07:01:07,814 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-14 07:01:07,814 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-14 07:01:07,815 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-14 07:01:07,816 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-14 07:01:07,820 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 07:01:07,820 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 07:01:07,821 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-14 07:01:07,821 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 07:01:07,821 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 07:01:07,822 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-14 07:01:07,822 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-14 07:01:08,663 WARN [Listener at jenkins-hbase4.apache.org/40843] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-14 07:01:08,668 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-09-14 07:01:08,676 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-14 07:01:09,156 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-14 07:01:09,158 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-14 07:01:09,383 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694674863103_0001_000001 (auth:SIMPLE) 2023-09-14 07:01:10,359 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-14 07:01:13,737 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694674863103_0001_000001 (auth:SIMPLE) 2023-09-14 07:01:15,995 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694674863103_0001_000001 (auth:SIMPLE) 2023-09-14 07:01:19,379 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694674863103_0001_000001 (auth:SIMPLE) 2023-09-14 07:01:20,534 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-14 07:01:20,539 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-14 07:01:20,551 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-09-14 07:01:20,551 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-14 07:01:20,552 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-14 07:01:20,552 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_409472800_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-14 07:01:20,553 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(367): hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-09-14 07:01:20,553 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(367): hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-09-14 07:01:20,553 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_409472800_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/export-test/export-1694674866649/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/export-test/export-1694674866649/.hbase-snapshot/testExportWithTargetName 2023-09-14 07:01:20,553 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(367): hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/export-test/export-1694674866649/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-09-14 07:01:20,554 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(367): hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/export-test/export-1694674866649/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-09-14 07:01:20,564 INFO [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-09-14 07:01:20,568 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-09-14 07:01:20,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-09-14 07:01:20,582 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694674880582"}]},"ts":"1694674880582"} 2023-09-14 07:01:20,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-14 07:01:20,584 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-09-14 07:01:20,586 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-09-14 07:01:20,587 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8909056e4588270f82eeb3121d081bf6, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cf98c44fd4e3647e59978712a1b34160, UNASSIGN}] 2023-09-14 07:01:20,590 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8909056e4588270f82eeb3121d081bf6, UNASSIGN 2023-09-14 07:01:20,590 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cf98c44fd4e3647e59978712a1b34160, UNASSIGN 2023-09-14 07:01:20,591 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=8909056e4588270f82eeb3121d081bf6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:20,591 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=cf98c44fd4e3647e59978712a1b34160, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:20,591 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1694674864358.8909056e4588270f82eeb3121d081bf6.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694674880591"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694674880591"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694674880591"}]},"ts":"1694674880591"} 2023-09-14 07:01:20,591 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1694674864358.cf98c44fd4e3647e59978712a1b34160.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694674880591"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694674880591"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694674880591"}]},"ts":"1694674880591"} 2023-09-14 07:01:20,593 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 8909056e4588270f82eeb3121d081bf6, server=jenkins-hbase4.apache.org,35941,1694674856649}] 2023-09-14 07:01:20,594 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure cf98c44fd4e3647e59978712a1b34160, server=jenkins-hbase4.apache.org,41005,1694674856735}] 2023-09-14 07:01:20,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-14 07:01:20,753 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close cf98c44fd4e3647e59978712a1b34160 2023-09-14 07:01:20,753 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8909056e4588270f82eeb3121d081bf6 2023-09-14 07:01:20,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cf98c44fd4e3647e59978712a1b34160, disabling compactions & flushes 2023-09-14 07:01:20,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8909056e4588270f82eeb3121d081bf6, disabling compactions & flushes 2023-09-14 07:01:20,753 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1694674864358.cf98c44fd4e3647e59978712a1b34160. 2023-09-14 07:01:20,753 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1694674864358.8909056e4588270f82eeb3121d081bf6. 2023-09-14 07:01:20,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1694674864358.cf98c44fd4e3647e59978712a1b34160. 2023-09-14 07:01:20,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1694674864358.8909056e4588270f82eeb3121d081bf6. 2023-09-14 07:01:20,754 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1694674864358.cf98c44fd4e3647e59978712a1b34160. after waiting 0 ms 2023-09-14 07:01:20,754 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1694674864358.cf98c44fd4e3647e59978712a1b34160. 2023-09-14 07:01:20,754 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1694674864358.8909056e4588270f82eeb3121d081bf6. after waiting 0 ms 2023-09-14 07:01:20,754 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1694674864358.8909056e4588270f82eeb3121d081bf6. 2023-09-14 07:01:20,769 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportWithTargetName/cf98c44fd4e3647e59978712a1b34160/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-14 07:01:20,769 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportWithTargetName/8909056e4588270f82eeb3121d081bf6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-14 07:01:20,770 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-14 07:01:20,770 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-14 07:01:20,771 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1694674864358.cf98c44fd4e3647e59978712a1b34160. 2023-09-14 07:01:20,771 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1694674864358.8909056e4588270f82eeb3121d081bf6. 2023-09-14 07:01:20,771 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cf98c44fd4e3647e59978712a1b34160: 2023-09-14 07:01:20,771 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8909056e4588270f82eeb3121d081bf6: 2023-09-14 07:01:20,774 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8909056e4588270f82eeb3121d081bf6 2023-09-14 07:01:20,775 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=8909056e4588270f82eeb3121d081bf6, regionState=CLOSED 2023-09-14 07:01:20,775 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed cf98c44fd4e3647e59978712a1b34160 2023-09-14 07:01:20,775 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1694674864358.8909056e4588270f82eeb3121d081bf6.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694674880775"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694674880775"}]},"ts":"1694674880775"} 2023-09-14 07:01:20,775 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=cf98c44fd4e3647e59978712a1b34160, regionState=CLOSED 2023-09-14 07:01:20,776 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1694674864358.cf98c44fd4e3647e59978712a1b34160.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694674880775"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694674880775"}]},"ts":"1694674880775"} 2023-09-14 07:01:20,780 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=22 2023-09-14 07:01:20,780 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 8909056e4588270f82eeb3121d081bf6, server=jenkins-hbase4.apache.org,35941,1694674856649 in 184 msec 2023-09-14 07:01:20,781 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=23 2023-09-14 07:01:20,781 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure cf98c44fd4e3647e59978712a1b34160, server=jenkins-hbase4.apache.org,41005,1694674856735 in 184 msec 2023-09-14 07:01:20,783 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8909056e4588270f82eeb3121d081bf6, UNASSIGN in 193 msec 2023-09-14 07:01:20,784 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=23, resume processing ppid=21 2023-09-14 07:01:20,784 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cf98c44fd4e3647e59978712a1b34160, UNASSIGN in 194 msec 2023-09-14 07:01:20,785 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694674880785"}]},"ts":"1694674880785"} 2023-09-14 07:01:20,787 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-09-14 07:01:20,788 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-09-14 07:01:20,792 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 218 msec 2023-09-14 07:01:20,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-14 07:01:20,886 INFO [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-09-14 07:01:20,890 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-09-14 07:01:20,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-14 07:01:20,900 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-14 07:01:20,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-09-14 07:01:20,902 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-14 07:01:20,905 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35941] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-09-14 07:01:20,908 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportWithTargetName/8909056e4588270f82eeb3121d081bf6 2023-09-14 07:01:20,908 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportWithTargetName/cf98c44fd4e3647e59978712a1b34160 2023-09-14 07:01:20,909 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-14 07:01:20,909 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-14 07:01:20,909 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-14 07:01:20,909 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-14 07:01:20,910 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-14 07:01:20,910 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-14 07:01:20,910 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-14 07:01:20,910 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-14 07:01:20,911 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-14 07:01:20,911 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 07:01:20,911 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-14 07:01:20,911 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-14 07:01:20,911 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 07:01:20,911 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 07:01:20,911 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-14 07:01:20,911 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 07:01:20,912 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportWithTargetName/cf98c44fd4e3647e59978712a1b34160/cf, FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportWithTargetName/cf98c44fd4e3647e59978712a1b34160/recovered.edits] 2023-09-14 07:01:20,912 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportWithTargetName/8909056e4588270f82eeb3121d081bf6/cf, FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportWithTargetName/8909056e4588270f82eeb3121d081bf6/recovered.edits] 2023-09-14 07:01:20,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-14 07:01:20,920 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportWithTargetName/cf98c44fd4e3647e59978712a1b34160/cf/016c2676014c4a0aa167e5509b27ada0 to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/archive/data/default/testtb-testExportWithTargetName/cf98c44fd4e3647e59978712a1b34160/cf/016c2676014c4a0aa167e5509b27ada0 2023-09-14 07:01:20,920 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportWithTargetName/8909056e4588270f82eeb3121d081bf6/cf/56affc01f0e944efb0c0719d1637752d to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/archive/data/default/testtb-testExportWithTargetName/8909056e4588270f82eeb3121d081bf6/cf/56affc01f0e944efb0c0719d1637752d 2023-09-14 07:01:20,925 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportWithTargetName/8909056e4588270f82eeb3121d081bf6/recovered.edits/9.seqid to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/archive/data/default/testtb-testExportWithTargetName/8909056e4588270f82eeb3121d081bf6/recovered.edits/9.seqid 2023-09-14 07:01:20,925 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportWithTargetName/cf98c44fd4e3647e59978712a1b34160/recovered.edits/9.seqid to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/archive/data/default/testtb-testExportWithTargetName/cf98c44fd4e3647e59978712a1b34160/recovered.edits/9.seqid 2023-09-14 07:01:20,925 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportWithTargetName/8909056e4588270f82eeb3121d081bf6 2023-09-14 07:01:20,926 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportWithTargetName/cf98c44fd4e3647e59978712a1b34160 2023-09-14 07:01:20,926 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-14 07:01:20,926 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-14 07:01:20,927 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-09-14 07:01:20,931 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230914c31edff529b34af48e4502773d1b018d to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230914c31edff529b34af48e4502773d1b018d 2023-09-14 07:01:20,932 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023091424241068a97c4f4da2feea2d039c0d07 to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023091424241068a97c4f4da2feea2d039c0d07 2023-09-14 07:01:20,933 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-14 07:01:20,936 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-14 07:01:20,957 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-09-14 07:01:20,960 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-09-14 07:01:20,961 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-14 07:01:20,961 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-09-14 07:01:20,962 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1694674864358.8909056e4588270f82eeb3121d081bf6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694674880962"}]},"ts":"9223372036854775807"} 2023-09-14 07:01:20,962 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1694674864358.cf98c44fd4e3647e59978712a1b34160.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694674880962"}]},"ts":"9223372036854775807"} 2023-09-14 07:01:20,964 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-14 07:01:20,964 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 8909056e4588270f82eeb3121d081bf6, NAME => 'testtb-testExportWithTargetName,,1694674864358.8909056e4588270f82eeb3121d081bf6.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => cf98c44fd4e3647e59978712a1b34160, NAME => 'testtb-testExportWithTargetName,1,1694674864358.cf98c44fd4e3647e59978712a1b34160.', STARTKEY => '1', ENDKEY => ''}] 2023-09-14 07:01:20,964 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-09-14 07:01:20,964 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694674880964"}]},"ts":"9223372036854775807"} 2023-09-14 07:01:20,966 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-09-14 07:01:20,969 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-14 07:01:20,971 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 77 msec 2023-09-14 07:01:21,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-14 07:01:21,018 INFO [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-09-14 07:01:21,036 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-09-14 07:01:21,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-09-14 07:01:21,041 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-09-14 07:01:21,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-09-14 07:01:21,072 INFO [Listener at jenkins-hbase4.apache.org/40843] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=758 (was 708) Potentially hanging thread: IPC Client (698022672) connection to jenkins-hbase4.apache.org/172.31.14.131:45359 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (698022672) connection to jenkins-hbase4.apache.org/172.31.14.131:38963 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x3a740ce4-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_409472800_17 at /127.0.0.1:34384 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3a740ce4-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/cluster_e41a8b39-3adf-15a8-f202-16f92e78dec5/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1514025096_1 at /127.0.0.1:34370 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1282 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/cluster_e41a8b39-3adf-15a8-f202-16f92e78dec5/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/cluster_e41a8b39-3adf-15a8-f202-16f92e78dec5/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (698022672) connection to jenkins-hbase4.apache.org/172.31.14.131:38045 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3a740ce4-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/cluster_e41a8b39-3adf-15a8-f202-16f92e78dec5/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3a740ce4-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/cluster_e41a8b39-3adf-15a8-f202-16f92e78dec5/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (698022672) connection to jenkins-hbase4.apache.org/172.31.14.131:40843 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_409472800_17 at /127.0.0.1:40250 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/cluster_e41a8b39-3adf-15a8-f202-16f92e78dec5/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_409472800_17 at /127.0.0.1:54904 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=939 (was 899) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=174 (was 118) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 163) - ProcessCount LEAK? -, AvailableMemoryMB=8734 (was 9535) 2023-09-14 07:01:21,073 WARN [Listener at jenkins-hbase4.apache.org/40843] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-09-14 07:01:21,095 INFO [Listener at jenkins-hbase4.apache.org/40843] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=758, OpenFileDescriptor=939, MaxFileDescriptor=60000, SystemLoadAverage=174, ProcessCount=167, AvailableMemoryMB=8734 2023-09-14 07:01:21,095 WARN [Listener at jenkins-hbase4.apache.org/40843] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-09-14 07:01:21,097 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-14 07:01:21,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-09-14 07:01:21,102 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-14 07:01:21,103 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-09-14 07:01:21,103 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-14 07:01:21,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-14 07:01:21,106 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemState/a051cb7a700a1a475f31b72b81844542 2023-09-14 07:01:21,107 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemState/2cfa76861414225dbf6d6adaf7934539 2023-09-14 07:01:21,107 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemState/a051cb7a700a1a475f31b72b81844542 empty. 2023-09-14 07:01:21,107 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemState/2cfa76861414225dbf6d6adaf7934539 empty. 2023-09-14 07:01:21,108 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemState/a051cb7a700a1a475f31b72b81844542 2023-09-14 07:01:21,108 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemState/2cfa76861414225dbf6d6adaf7934539 2023-09-14 07:01:21,108 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-14 07:01:21,119 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-14 07:01:21,120 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => a051cb7a700a1a475f31b72b81844542, NAME => 'testtb-testExportFileSystemState,,1694674881097.a051cb7a700a1a475f31b72b81844542.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp 2023-09-14 07:01:21,121 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 2cfa76861414225dbf6d6adaf7934539, NAME => 'testtb-testExportFileSystemState,1,1694674881097.2cfa76861414225dbf6d6adaf7934539.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp 2023-09-14 07:01:21,145 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1694674881097.a051cb7a700a1a475f31b72b81844542.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 07:01:21,146 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1694674881097.2cfa76861414225dbf6d6adaf7934539.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 07:01:21,147 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing a051cb7a700a1a475f31b72b81844542, disabling compactions & flushes 2023-09-14 07:01:21,148 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 2cfa76861414225dbf6d6adaf7934539, disabling compactions & flushes 2023-09-14 07:01:21,148 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1694674881097.a051cb7a700a1a475f31b72b81844542. 2023-09-14 07:01:21,148 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1694674881097.2cfa76861414225dbf6d6adaf7934539. 2023-09-14 07:01:21,148 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1694674881097.a051cb7a700a1a475f31b72b81844542. 2023-09-14 07:01:21,148 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1694674881097.2cfa76861414225dbf6d6adaf7934539. 2023-09-14 07:01:21,148 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1694674881097.a051cb7a700a1a475f31b72b81844542. after waiting 0 ms 2023-09-14 07:01:21,148 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1694674881097.2cfa76861414225dbf6d6adaf7934539. after waiting 0 ms 2023-09-14 07:01:21,148 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1694674881097.a051cb7a700a1a475f31b72b81844542. 2023-09-14 07:01:21,148 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1694674881097.2cfa76861414225dbf6d6adaf7934539. 2023-09-14 07:01:21,148 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1694674881097.a051cb7a700a1a475f31b72b81844542. 2023-09-14 07:01:21,148 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1694674881097.2cfa76861414225dbf6d6adaf7934539. 2023-09-14 07:01:21,148 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for a051cb7a700a1a475f31b72b81844542: 2023-09-14 07:01:21,148 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 2cfa76861414225dbf6d6adaf7934539: 2023-09-14 07:01:21,151 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-14 07:01:21,152 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1694674881097.a051cb7a700a1a475f31b72b81844542.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694674881152"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694674881152"}]},"ts":"1694674881152"} 2023-09-14 07:01:21,152 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1694674881097.2cfa76861414225dbf6d6adaf7934539.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694674881152"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694674881152"}]},"ts":"1694674881152"} 2023-09-14 07:01:21,155 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-14 07:01:21,156 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-14 07:01:21,156 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694674881156"}]},"ts":"1694674881156"} 2023-09-14 07:01:21,158 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-09-14 07:01:21,163 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-14 07:01:21,164 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-14 07:01:21,164 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-14 07:01:21,164 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-14 07:01:21,164 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-14 07:01:21,164 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a051cb7a700a1a475f31b72b81844542, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2cfa76861414225dbf6d6adaf7934539, ASSIGN}] 2023-09-14 07:01:21,167 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a051cb7a700a1a475f31b72b81844542, ASSIGN 2023-09-14 07:01:21,167 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2cfa76861414225dbf6d6adaf7934539, ASSIGN 2023-09-14 07:01:21,168 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2cfa76861414225dbf6d6adaf7934539, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41005,1694674856735; forceNewPlan=false, retain=false 2023-09-14 07:01:21,168 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a051cb7a700a1a475f31b72b81844542, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37703,1694674856695; forceNewPlan=false, retain=false 2023-09-14 07:01:21,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-14 07:01:21,318 INFO [jenkins-hbase4:33055] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-14 07:01:21,321 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=2cfa76861414225dbf6d6adaf7934539, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:21,321 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=a051cb7a700a1a475f31b72b81844542, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:21,321 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1694674881097.a051cb7a700a1a475f31b72b81844542.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694674881321"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694674881321"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694674881321"}]},"ts":"1694674881321"} 2023-09-14 07:01:21,321 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1694674881097.2cfa76861414225dbf6d6adaf7934539.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694674881321"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694674881321"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694674881321"}]},"ts":"1694674881321"} 2023-09-14 07:01:21,324 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 2cfa76861414225dbf6d6adaf7934539, server=jenkins-hbase4.apache.org,41005,1694674856735}] 2023-09-14 07:01:21,325 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure a051cb7a700a1a475f31b72b81844542, server=jenkins-hbase4.apache.org,37703,1694674856695}] 2023-09-14 07:01:21,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-14 07:01:21,485 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1694674881097.2cfa76861414225dbf6d6adaf7934539. 2023-09-14 07:01:21,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2cfa76861414225dbf6d6adaf7934539, NAME => 'testtb-testExportFileSystemState,1,1694674881097.2cfa76861414225dbf6d6adaf7934539.', STARTKEY => '1', ENDKEY => ''} 2023-09-14 07:01:21,486 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1694674881097.a051cb7a700a1a475f31b72b81844542. 2023-09-14 07:01:21,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1694674881097.2cfa76861414225dbf6d6adaf7934539. service=AccessControlService 2023-09-14 07:01:21,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a051cb7a700a1a475f31b72b81844542, NAME => 'testtb-testExportFileSystemState,,1694674881097.a051cb7a700a1a475f31b72b81844542.', STARTKEY => '', ENDKEY => '1'} 2023-09-14 07:01:21,486 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-14 07:01:21,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 2cfa76861414225dbf6d6adaf7934539 2023-09-14 07:01:21,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1694674881097.2cfa76861414225dbf6d6adaf7934539.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 07:01:21,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2cfa76861414225dbf6d6adaf7934539 2023-09-14 07:01:21,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2cfa76861414225dbf6d6adaf7934539 2023-09-14 07:01:21,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1694674881097.a051cb7a700a1a475f31b72b81844542. service=AccessControlService 2023-09-14 07:01:21,487 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-14 07:01:21,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState a051cb7a700a1a475f31b72b81844542 2023-09-14 07:01:21,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1694674881097.a051cb7a700a1a475f31b72b81844542.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 07:01:21,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a051cb7a700a1a475f31b72b81844542 2023-09-14 07:01:21,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a051cb7a700a1a475f31b72b81844542 2023-09-14 07:01:21,488 INFO [StoreOpener-2cfa76861414225dbf6d6adaf7934539-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2cfa76861414225dbf6d6adaf7934539 2023-09-14 07:01:21,488 INFO [StoreOpener-a051cb7a700a1a475f31b72b81844542-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a051cb7a700a1a475f31b72b81844542 2023-09-14 07:01:21,489 DEBUG [StoreOpener-2cfa76861414225dbf6d6adaf7934539-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemState/2cfa76861414225dbf6d6adaf7934539/cf 2023-09-14 07:01:21,490 DEBUG [StoreOpener-2cfa76861414225dbf6d6adaf7934539-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemState/2cfa76861414225dbf6d6adaf7934539/cf 2023-09-14 07:01:21,490 DEBUG [StoreOpener-a051cb7a700a1a475f31b72b81844542-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemState/a051cb7a700a1a475f31b72b81844542/cf 2023-09-14 07:01:21,490 DEBUG [StoreOpener-a051cb7a700a1a475f31b72b81844542-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemState/a051cb7a700a1a475f31b72b81844542/cf 2023-09-14 07:01:21,490 INFO [StoreOpener-2cfa76861414225dbf6d6adaf7934539-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2cfa76861414225dbf6d6adaf7934539 columnFamilyName cf 2023-09-14 07:01:21,490 INFO [StoreOpener-a051cb7a700a1a475f31b72b81844542-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a051cb7a700a1a475f31b72b81844542 columnFamilyName cf 2023-09-14 07:01:21,492 INFO [StoreOpener-2cfa76861414225dbf6d6adaf7934539-1] regionserver.HStore(310): Store=2cfa76861414225dbf6d6adaf7934539/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-14 07:01:21,492 INFO [StoreOpener-a051cb7a700a1a475f31b72b81844542-1] regionserver.HStore(310): Store=a051cb7a700a1a475f31b72b81844542/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-14 07:01:21,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemState/a051cb7a700a1a475f31b72b81844542 2023-09-14 07:01:21,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemState/2cfa76861414225dbf6d6adaf7934539 2023-09-14 07:01:21,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemState/a051cb7a700a1a475f31b72b81844542 2023-09-14 07:01:21,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemState/2cfa76861414225dbf6d6adaf7934539 2023-09-14 07:01:21,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a051cb7a700a1a475f31b72b81844542 2023-09-14 07:01:21,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2cfa76861414225dbf6d6adaf7934539 2023-09-14 07:01:21,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemState/a051cb7a700a1a475f31b72b81844542/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-14 07:01:21,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemState/2cfa76861414225dbf6d6adaf7934539/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-14 07:01:21,502 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a051cb7a700a1a475f31b72b81844542; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65777715, jitterRate=-0.019835665822029114}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-14 07:01:21,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a051cb7a700a1a475f31b72b81844542: 2023-09-14 07:01:21,502 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2cfa76861414225dbf6d6adaf7934539; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63853175, jitterRate=-0.04851354658603668}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-14 07:01:21,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2cfa76861414225dbf6d6adaf7934539: 2023-09-14 07:01:21,503 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1694674881097.a051cb7a700a1a475f31b72b81844542., pid=31, masterSystemTime=1694674881478 2023-09-14 07:01:21,503 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1694674881097.2cfa76861414225dbf6d6adaf7934539., pid=30, masterSystemTime=1694674881478 2023-09-14 07:01:21,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1694674881097.2cfa76861414225dbf6d6adaf7934539. 2023-09-14 07:01:21,505 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1694674881097.2cfa76861414225dbf6d6adaf7934539. 2023-09-14 07:01:21,506 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=2cfa76861414225dbf6d6adaf7934539, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:21,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1694674881097.a051cb7a700a1a475f31b72b81844542. 2023-09-14 07:01:21,506 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1694674881097.a051cb7a700a1a475f31b72b81844542. 2023-09-14 07:01:21,506 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1694674881097.2cfa76861414225dbf6d6adaf7934539.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694674881506"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694674881506"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694674881506"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694674881506"}]},"ts":"1694674881506"} 2023-09-14 07:01:21,507 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=a051cb7a700a1a475f31b72b81844542, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:21,507 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1694674881097.a051cb7a700a1a475f31b72b81844542.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694674881507"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694674881507"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694674881507"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694674881507"}]},"ts":"1694674881507"} 2023-09-14 07:01:21,511 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=29 2023-09-14 07:01:21,513 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 2cfa76861414225dbf6d6adaf7934539, server=jenkins-hbase4.apache.org,41005,1694674856735 in 185 msec 2023-09-14 07:01:21,514 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=28 2023-09-14 07:01:21,518 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure a051cb7a700a1a475f31b72b81844542, server=jenkins-hbase4.apache.org,37703,1694674856695 in 185 msec 2023-09-14 07:01:21,519 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2cfa76861414225dbf6d6adaf7934539, ASSIGN in 349 msec 2023-09-14 07:01:21,521 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=28, resume processing ppid=27 2023-09-14 07:01:21,521 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a051cb7a700a1a475f31b72b81844542, ASSIGN in 354 msec 2023-09-14 07:01:21,522 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-14 07:01:21,522 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694674881522"}]},"ts":"1694674881522"} 2023-09-14 07:01:21,523 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-09-14 07:01:21,526 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-14 07:01:21,526 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-09-14 07:01:21,528 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35941] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-14 07:01:21,530 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 07:01:21,530 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 07:01:21,530 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 07:01:21,530 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 07:01:21,532 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-14 07:01:21,532 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-14 07:01:21,532 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-14 07:01:21,532 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-14 07:01:21,533 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 433 msec 2023-09-14 07:01:21,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-14 07:01:21,708 INFO [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-09-14 07:01:21,711 DEBUG [Listener at jenkins-hbase4.apache.org/40843] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-14 07:01:21,711 DEBUG [Listener at jenkins-hbase4.apache.org/40843] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1694674881097.a051cb7a700a1a475f31b72b81844542. 2023-09-14 07:01:21,713 INFO [Listener at jenkins-hbase4.apache.org/40843] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-14 07:01:21,726 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-14 07:01:21,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694674881727 (current time:1694674881727). 2023-09-14 07:01:21,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-14 07:01:21,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] zookeeper.ReadOnlyZKClient(139): Connect 0x236fccff to 127.0.0.1:52295 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 07:01:21,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5402656d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 07:01:21,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 07:01:21,743 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40806, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 07:01:21,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x236fccff to 127.0.0.1:52295 2023-09-14 07:01:21,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 07:01:21,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] zookeeper.ReadOnlyZKClient(139): Connect 0x080549cb to 127.0.0.1:52295 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 07:01:21,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@55d06400, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 07:01:21,753 DEBUG [hconnection-0x123e4ada-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 07:01:21,755 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40822, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 07:01:21,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 07:01:21,761 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47680, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 07:01:21,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x080549cb to 127.0.0.1:52295 2023-09-14 07:01:21,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 07:01:21,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-14 07:01:21,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-14 07:01:21,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-14 07:01:21,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-14 07:01:21,767 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-14 07:01:21,768 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1694675481768 2023-09-14 07:01:21,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-14 07:01:21,769 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-14 07:01:21,770 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-14 07:01:21,771 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-14 07:01:21,772 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-14 07:01:21,773 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-14 07:01:21,774 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-09-14 07:01:21,775 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-14 07:01:21,776 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1694675481776 2023-09-14 07:01:21,794 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,795 INFO [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-09-14 07:01:21,795 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 07:01:21,796 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-09-14 07:01:21,796 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-14 07:01:21,797 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,797 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,799 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:01:21,799 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:01:21,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:01:21,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:01:21,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:01:21,799 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:21,799 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:01:21,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:01:21,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:01:21,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:01:21,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,800 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:21,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,800 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:21,800 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,800 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,800 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:21,800 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-14 07:01:21,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-14 07:01:21,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-14 07:01:21,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,801 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-14 07:01:21,801 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-14 07:01:21,801 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,801 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,801 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,801 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-14 07:01:21,801 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-14 07:01:21,801 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 07:01:21,801 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 07:01:21,803 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-14 07:01:21,803 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-14 07:01:21,803 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35941,1694674856649' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-14 07:01:21,803 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-14 07:01:21,803 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-14 07:01:21,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-14 07:01:21,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,803 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37703,1694674856695' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-14 07:01:21,803 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-14 07:01:21,804 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,804 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-14 07:01:21,804 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 07:01:21,805 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-14 07:01:21,805 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-14 07:01:21,805 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41005,1694674856735' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-14 07:01:21,805 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,815 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,815 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:21,815 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:21,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:01:21,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:01:21,815 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 07:01:21,815 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,815 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 07:01:21,817 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:21,817 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:01:21,817 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:01:21,817 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 07:01:21,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:21,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:21,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:21,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:01:21,819 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37703,1694674856695' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-14 07:01:21,819 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6361b1c3[Count = 1] remaining members to acquire global barrier 2023-09-14 07:01:21,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:21,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:01:21,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:01:21,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:01:21,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:01:21,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:21,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:21,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:21,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:01:21,822 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41005,1694674856735' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-14 07:01:21,822 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6361b1c3[Count = 0] remaining members to acquire global barrier 2023-09-14 07:01:21,822 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-14 07:01:21,822 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,823 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,823 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,823 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,823 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:21,823 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-14 07:01:21,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,824 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-14 07:01:21,824 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-14 07:01:21,824 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1694674881097.a051cb7a700a1a475f31b72b81844542. 2023-09-14 07:01:21,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,824 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:21,824 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-14 07:01:21,824 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-14 07:01:21,824 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1694674881097.a051cb7a700a1a475f31b72b81844542. started... 2023-09-14 07:01:21,824 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-14 07:01:21,824 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-14 07:01:21,824 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35941,1694674856649' in zk 2023-09-14 07:01:21,824 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1694674881097.2cfa76861414225dbf6d6adaf7934539. 2023-09-14 07:01:21,824 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-14 07:01:21,824 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a051cb7a700a1a475f31b72b81844542: 2023-09-14 07:01:21,824 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1694674881097.2cfa76861414225dbf6d6adaf7934539. started... 2023-09-14 07:01:21,824 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-14 07:01:21,826 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1694674881097.a051cb7a700a1a475f31b72b81844542.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,826 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2cfa76861414225dbf6d6adaf7934539: 2023-09-14 07:01:21,826 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-14 07:01:21,826 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-14 07:01:21,826 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1694674881097.2cfa76861414225dbf6d6adaf7934539.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,826 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-14 07:01:21,826 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-14 07:01:21,827 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-14 07:01:21,827 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 07:01:21,827 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-14 07:01:21,844 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1694674881097.a051cb7a700a1a475f31b72b81844542. completed. 2023-09-14 07:01:21,845 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1694674881097.a051cb7a700a1a475f31b72b81844542. 2023-09-14 07:01:21,847 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-14 07:01:21,847 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-14 07:01:21,847 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:21,848 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-14 07:01:21,848 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37703,1694674856695' in zk 2023-09-14 07:01:21,850 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-14 07:01:21,850 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:21,850 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 07:01:21,850 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-14 07:01:21,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:21,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:01:21,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:01:21,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:01:21,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:01:21,851 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1694674881097.2cfa76861414225dbf6d6adaf7934539. completed. 2023-09-14 07:01:21,851 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1694674881097.2cfa76861414225dbf6d6adaf7934539. 2023-09-14 07:01:21,851 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-14 07:01:21,851 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-14 07:01:21,851 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:21,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,851 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-14 07:01:21,851 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41005,1694674856735' in zk 2023-09-14 07:01:21,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:21,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:21,854 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:21,854 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-14 07:01:21,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:21,854 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 07:01:21,854 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-14 07:01:21,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:01:21,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:21,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:21,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:21,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,37703,1694674856695': 2023-09-14 07:01:21,857 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37703,1694674856695' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-14 07:01:21,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:21,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:01:21,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:01:21,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:01:21,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:01:21,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:21,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:21,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:21,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:01:21,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:21,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:21,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:21,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,41005,1694674856735': 2023-09-14 07:01:21,861 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41005,1694674856735' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-14 07:01:21,861 INFO [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-09-14 07:01:21,861 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-14 07:01:21,862 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-14 07:01:21,862 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,862 INFO [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-14 07:01:21,863 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,863 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,863 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:01:21,863 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:01:21,863 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,863 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:01:21,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:01:21,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,864 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:21,864 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:01:21,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:01:21,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:01:21,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:01:21,865 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:21,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:01:21,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:01:21,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:01:21,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,866 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:21,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:21,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:21,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:21,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:01:21,868 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:21,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,868 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:21,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:21,869 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:21,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:21,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:21,871 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-14 07:01:21,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-14 07:01:21,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-14 07:01:21,872 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-14 07:01:21,872 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:01:21,873 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:01:21,873 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:01:21,873 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:21,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:01:21,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:01:21,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:01:21,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:01:21,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:01:21,873 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,873 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:01:21,873 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-14 07:01:21,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:01:21,873 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,873 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,873 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:01:21,873 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:21,873 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:21,873 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,873 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:21,873 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,873 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:21,873 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:21,873 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,873 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,873 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 07:01:21,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:01:21,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:01:21,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:01:21,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:01:21,873 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-14 07:01:21,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:01:21,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:01:21,876 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-14 07:01:21,888 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,889 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,921 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,922 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-14 07:01:21,922 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,922 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:21,922 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1694674881769Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1694674881888 (+119 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1694674881888Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1694674881888Writing data manifest for emptySnaptb0-testExportFileSystemState at 1694674881894 (+6 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1694674881910 (+16 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1694674881922 (+12 ms) 2023-09-14 07:01:21,926 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-14 07:01:21,928 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 156 msec 2023-09-14 07:01:22,072 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-14 07:01:22,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-14 07:01:22,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-14 07:01:22,077 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37703] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1694674881097.a051cb7a700a1a475f31b72b81844542. with WAL disabled. Data may be lost in the event of a crash. 2023-09-14 07:01:22,079 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41005] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1694674881097.2cfa76861414225dbf6d6adaf7934539. with WAL disabled. Data may be lost in the event of a crash. 2023-09-14 07:01:22,084 DEBUG [Listener at jenkins-hbase4.apache.org/40843] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-14 07:01:22,084 DEBUG [Listener at jenkins-hbase4.apache.org/40843] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1694674881097.a051cb7a700a1a475f31b72b81844542. 2023-09-14 07:01:22,085 INFO [Listener at jenkins-hbase4.apache.org/40843] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-14 07:01:22,096 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-14 07:01:22,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694674882096 (current time:1694674882096). 2023-09-14 07:01:22,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-14 07:01:22,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] zookeeper.ReadOnlyZKClient(139): Connect 0x6a521039 to 127.0.0.1:52295 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 07:01:22,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3dde7703, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 07:01:22,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 07:01:22,109 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40826, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 07:01:22,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a521039 to 127.0.0.1:52295 2023-09-14 07:01:22,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 07:01:22,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] zookeeper.ReadOnlyZKClient(139): Connect 0x5fe57edb to 127.0.0.1:52295 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 07:01:22,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b647303, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 07:01:22,118 DEBUG [hconnection-0x3735055c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 07:01:22,120 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40838, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 07:01:22,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 07:01:22,127 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47690, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 07:01:22,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5fe57edb to 127.0.0.1:52295 2023-09-14 07:01:22,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 07:01:22,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-14 07:01:22,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-14 07:01:22,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-14 07:01:22,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-14 07:01:22,133 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-14 07:01:22,134 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1694675482134 2023-09-14 07:01:22,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-14 07:01:22,135 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-14 07:01:22,136 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-14 07:01:22,136 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-14 07:01:22,138 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-14 07:01:22,138 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-14 07:01:22,146 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-09-14 07:01:22,147 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-14 07:01:22,148 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1694675482148 2023-09-14 07:01:22,162 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-09-14 07:01:22,162 INFO [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-09-14 07:01:22,162 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 07:01:22,164 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-09-14 07:01:22,164 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-14 07:01:22,165 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-14 07:01:22,165 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-14 07:01:22,166 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:01:22,166 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:01:22,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:01:22,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:01:22,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:01:22,166 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:22,166 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:01:22,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:01:22,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:01:22,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:01:22,167 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:22,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-14 07:01:22,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-14 07:01:22,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-14 07:01:22,167 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:22,167 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-14 07:01:22,167 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-14 07:01:22,167 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:22,167 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-14 07:01:22,167 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-14 07:01:22,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-14 07:01:22,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-14 07:01:22,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-14 07:01:22,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-14 07:01:22,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-14 07:01:22,168 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-14 07:01:22,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-14 07:01:22,168 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-14 07:01:22,168 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-14 07:01:22,168 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-14 07:01:22,168 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-14 07:01:22,168 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 07:01:22,168 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-14 07:01:22,168 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-14 07:01:22,170 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-14 07:01:22,170 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-14 07:01:22,169 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-14 07:01:22,170 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-14 07:01:22,170 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 07:01:22,170 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 07:01:22,171 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-14 07:01:22,172 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-14 07:01:22,172 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-14 07:01:22,170 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37703,1694674856695' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-14 07:01:22,172 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35941,1694674856649' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-14 07:01:22,172 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-14 07:01:22,172 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41005,1694674856735' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-14 07:01:22,175 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:22,175 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-14 07:01:22,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:22,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:01:22,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:01:22,175 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:22,175 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-14 07:01:22,176 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-14 07:01:22,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:01:22,176 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-14 07:01:22,176 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 07:01:22,176 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-14 07:01:22,176 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 07:01:22,176 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-14 07:01:22,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:01:22,176 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 07:01:22,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-14 07:01:22,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:22,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:22,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:22,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:01:22,178 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41005,1694674856735' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-14 07:01:22,178 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@623fc09[Count = 1] remaining members to acquire global barrier 2023-09-14 07:01:22,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:22,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:01:22,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:01:22,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:01:22,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:01:22,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-14 07:01:22,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:22,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:22,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:22,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:01:22,180 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37703,1694674856695' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-14 07:01:22,180 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@623fc09[Count = 0] remaining members to acquire global barrier 2023-09-14 07:01:22,180 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-14 07:01:22,181 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-14 07:01:22,182 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-14 07:01:22,182 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-14 07:01:22,182 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-14 07:01:22,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-14 07:01:22,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-14 07:01:22,182 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-14 07:01:22,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-14 07:01:22,182 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-14 07:01:22,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-14 07:01:22,182 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35941,1694674856649' in zk 2023-09-14 07:01:22,182 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:22,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-14 07:01:22,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-14 07:01:22,182 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-14 07:01:22,182 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-14 07:01:22,183 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-14 07:01:22,183 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-14 07:01:22,183 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1694674881097.a051cb7a700a1a475f31b72b81844542. 2023-09-14 07:01:22,183 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:22,183 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-14 07:01:22,183 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1694674881097.a051cb7a700a1a475f31b72b81844542. started... 2023-09-14 07:01:22,183 INFO [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a051cb7a700a1a475f31b72b81844542 1/1 column families, dataSize=132 B heapSize=544 B 2023-09-14 07:01:22,184 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-14 07:01:22,184 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 07:01:22,184 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-14 07:01:22,191 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-14 07:01:22,192 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-14 07:01:22,192 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1694674881097.2cfa76861414225dbf6d6adaf7934539. 2023-09-14 07:01:22,192 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1694674881097.2cfa76861414225dbf6d6adaf7934539. started... 2023-09-14 07:01:22,192 INFO [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2cfa76861414225dbf6d6adaf7934539 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-09-14 07:01:22,223 INFO [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230914f4c2fca2e79f4ddcb3e09c9d12da8cc9 to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230914f4c2fca2e79f4ddcb3e09c9d12da8cc9 2023-09-14 07:01:22,226 INFO [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023091456bf931ea8ce4461b0d8370f854065ad to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023091456bf931ea8ce4461b0d8370f854065ad 2023-09-14 07:01:22,236 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-14 07:01:22,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-14 07:01:22,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-14 07:01:22,238 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-14 07:01:22,242 INFO [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemState/a051cb7a700a1a475f31b72b81844542/.tmp/cf/5cf20bd13b494fe38ce51fd11d5dcfad 2023-09-14 07:01:22,250 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemState/a051cb7a700a1a475f31b72b81844542/.tmp/cf/5cf20bd13b494fe38ce51fd11d5dcfad as hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemState/a051cb7a700a1a475f31b72b81844542/cf/5cf20bd13b494fe38ce51fd11d5dcfad 2023-09-14 07:01:22,256 INFO [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemState/a051cb7a700a1a475f31b72b81844542/cf/5cf20bd13b494fe38ce51fd11d5dcfad, entries=2, sequenceid=6, filesize=5.2 K 2023-09-14 07:01:22,257 INFO [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for a051cb7a700a1a475f31b72b81844542 in 74ms, sequenceid=6, compaction requested=false 2023-09-14 07:01:22,257 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-09-14 07:01:22,258 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a051cb7a700a1a475f31b72b81844542: 2023-09-14 07:01:22,258 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1694674881097.a051cb7a700a1a475f31b72b81844542.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-14 07:01:22,258 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-14 07:01:22,258 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemState/a051cb7a700a1a475f31b72b81844542/cf/5cf20bd13b494fe38ce51fd11d5dcfad] hfiles 2023-09-14 07:01:22,258 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemState/a051cb7a700a1a475f31b72b81844542/cf/5cf20bd13b494fe38ce51fd11d5dcfad for snapshot=snaptb0-testExportFileSystemState 2023-09-14 07:01:22,272 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1694674881097.a051cb7a700a1a475f31b72b81844542. completed. 2023-09-14 07:01:22,273 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1694674881097.a051cb7a700a1a475f31b72b81844542. 2023-09-14 07:01:22,273 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-14 07:01:22,273 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-14 07:01:22,273 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:22,273 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-14 07:01:22,273 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37703,1694674856695' in zk 2023-09-14 07:01:22,278 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-14 07:01:22,278 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:22,278 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 07:01:22,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:22,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:01:22,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:01:22,278 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-14 07:01:22,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:01:22,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:01:22,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-14 07:01:22,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:22,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:22,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:22,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:01:22,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-14 07:01:22,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:22,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:22,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,37703,1694674856695': 2023-09-14 07:01:22,284 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37703,1694674856695' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-14 07:01:22,438 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-14 07:01:22,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-14 07:01:22,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-14 07:01:22,440 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-14 07:01:22,644 INFO [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemState/2cfa76861414225dbf6d6adaf7934539/.tmp/cf/3163ad6ddb06407284b24d15884c0df3 2023-09-14 07:01:22,651 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemState/2cfa76861414225dbf6d6adaf7934539/.tmp/cf/3163ad6ddb06407284b24d15884c0df3 as hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemState/2cfa76861414225dbf6d6adaf7934539/cf/3163ad6ddb06407284b24d15884c0df3 2023-09-14 07:01:22,657 INFO [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemState/2cfa76861414225dbf6d6adaf7934539/cf/3163ad6ddb06407284b24d15884c0df3, entries=48, sequenceid=6, filesize=13.0 K 2023-09-14 07:01:22,658 INFO [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 2cfa76861414225dbf6d6adaf7934539 in 466ms, sequenceid=6, compaction requested=false 2023-09-14 07:01:22,660 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2cfa76861414225dbf6d6adaf7934539: 2023-09-14 07:01:22,660 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1694674881097.2cfa76861414225dbf6d6adaf7934539.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-14 07:01:22,661 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-14 07:01:22,661 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemState/2cfa76861414225dbf6d6adaf7934539/cf/3163ad6ddb06407284b24d15884c0df3] hfiles 2023-09-14 07:01:22,661 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemState/2cfa76861414225dbf6d6adaf7934539/cf/3163ad6ddb06407284b24d15884c0df3 for snapshot=snaptb0-testExportFileSystemState 2023-09-14 07:01:22,674 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1694674881097.2cfa76861414225dbf6d6adaf7934539. completed. 2023-09-14 07:01:22,674 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1694674881097.2cfa76861414225dbf6d6adaf7934539. 2023-09-14 07:01:22,674 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-14 07:01:22,674 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-14 07:01:22,674 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:22,674 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-14 07:01:22,674 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41005,1694674856735' in zk 2023-09-14 07:01:22,676 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-14 07:01:22,676 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:22,676 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 07:01:22,676 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-14 07:01:22,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:22,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:01:22,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:01:22,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:01:22,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:01:22,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-14 07:01:22,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:22,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:22,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:22,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:01:22,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-14 07:01:22,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:22,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:22,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:22,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,41005,1694674856735': 2023-09-14 07:01:22,682 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41005,1694674856735' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-14 07:01:22,682 INFO [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-09-14 07:01:22,682 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-14 07:01:22,682 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-14 07:01:22,682 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-09-14 07:01:22,682 INFO [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-14 07:01:22,684 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-14 07:01:22,684 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-14 07:01:22,684 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:01:22,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-14 07:01:22,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:01:22,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:01:22,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-14 07:01:22,684 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-14 07:01:22,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-14 07:01:22,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-14 07:01:22,684 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-14 07:01:22,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-14 07:01:22,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-14 07:01:22,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-14 07:01:22,685 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:01:22,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:01:22,685 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:01:22,685 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:22,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:01:22,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:01:22,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:01:22,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:01:22,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:01:22,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:01:22,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-14 07:01:22,686 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:22,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-14 07:01:22,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:01:22,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-14 07:01:22,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-14 07:01:22,686 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:22,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-14 07:01:22,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:22,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:22,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:22,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:01:22,689 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:22,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-14 07:01:22,689 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:22,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:22,689 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:22,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:22,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:22,692 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:22,693 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:01:22,693 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:01:22,693 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-14 07:01:22,693 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:01:22,693 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-09-14 07:01:22,693 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-14 07:01:22,693 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-14 07:01:22,693 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-14 07:01:22,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:01:22,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:01:22,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:01:22,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:01:22,693 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:01:22,693 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:22,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:01:22,693 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:01:22,693 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 07:01:22,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:01:22,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:01:22,694 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:22,694 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:01:22,695 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-14 07:01:22,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:01:22,696 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:22,696 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023091456bf931ea8ce4461b0d8370f854065ad, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230914f4c2fca2e79f4ddcb3e09c9d12da8cc9] mob files 2023-09-14 07:01:22,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:01:22,696 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-14 07:01:22,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:01:22,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:01:22,696 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023091456bf931ea8ce4461b0d8370f854065ad 2023-09-14 07:01:22,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:01:22,696 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230914f4c2fca2e79f4ddcb3e09c9d12da8cc9 2023-09-14 07:01:22,696 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:22,696 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:22,696 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-14 07:01:22,696 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-14 07:01:22,711 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-09-14 07:01:22,712 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-14 07:01:22,740 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-14 07:01:22,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-14 07:01:22,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-14 07:01:22,742 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-09-14 07:01:22,749 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-14 07:01:22,750 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-14 07:01:22,750 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-14 07:01:22,750 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-14 07:01:22,750 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1694674882135Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1694674882711 (+576 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1694674882711Loading Region manifests for snaptb0-testExportFileSystemState at 1694674882712 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemState at 1694674882715 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1694674882729 (+14 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1694674882750 (+21 ms) 2023-09-14 07:01:22,753 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-14 07:01:22,755 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 617 msec 2023-09-14 07:01:23,242 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-14 07:01:23,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-14 07:01:23,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-14 07:01:23,244 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/export-test/export-1694674883244 2023-09-14 07:01:23,244 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44283, tgtDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/export-test/export-1694674883244, rawTgtDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/export-test/export-1694674883244, srcFsUri=hdfs://localhost:44283, srcDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04 2023-09-14 07:01:23,269 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44283, inputRoot=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04 2023-09-14 07:01:23,269 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1847800606_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/export-test/export-1694674883244, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/export-test/export-1694674883244/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-14 07:01:23,269 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44283, inputRoot=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04, snapshotDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-09-14 07:01:23,286 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/export-test/export-1694674883244/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-14 07:01:23,324 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-14 07:01:23,325 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-14 07:01:23,325 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-14 07:01:23,326 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-14 07:01:24,279 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/hadoop-4013924188567951595.jar 2023-09-14 07:01:24,280 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-14 07:01:24,280 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-14 07:01:24,347 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/hadoop-8393287695403738111.jar 2023-09-14 07:01:24,348 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-14 07:01:24,348 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-14 07:01:24,349 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-14 07:01:24,349 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-14 07:01:24,349 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-14 07:01:24,350 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-14 07:01:24,350 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-14 07:01:24,351 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-14 07:01:24,351 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-14 07:01:24,351 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-14 07:01:24,352 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-14 07:01:24,352 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-14 07:01:24,353 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-14 07:01:24,353 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-14 07:01:24,354 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-14 07:01:24,354 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-14 07:01:24,355 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 07:01:24,355 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 07:01:24,356 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-14 07:01:24,356 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 07:01:24,357 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 07:01:24,358 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-14 07:01:24,358 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-14 07:01:24,848 WARN [Listener at jenkins-hbase4.apache.org/40843] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-14 07:01:24,851 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-09-14 07:01:24,854 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-14 07:01:25,478 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-14 07:01:25,479 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-14 07:01:25,484 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694674863103_0001_000001 (auth:SIMPLE) 2023-09-14 07:01:26,357 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694674863103_0002_000001 (auth:SIMPLE) 2023-09-14 07:01:26,363 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-14 07:01:30,464 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694674863103_0002_000001 (auth:SIMPLE) 2023-09-14 07:01:32,713 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694674863103_0002_000001 (auth:SIMPLE) 2023-09-14 07:01:35,398 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694674863103_0002_000001 (auth:SIMPLE) 2023-09-14 07:01:37,049 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-14 07:01:37,050 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-14 07:01:37,058 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-09-14 07:01:37,058 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-14 07:01:37,058 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-14 07:01:37,059 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_409472800_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-14 07:01:37,059 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(367): hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-14 07:01:37,059 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(367): hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-14 07:01:37,059 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_409472800_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/export-test/export-1694674883244/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/export-test/export-1694674883244/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-14 07:01:37,060 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(367): hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/export-test/export-1694674883244/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-14 07:01:37,060 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(367): hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/export-test/export-1694674883244/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-14 07:01:37,067 INFO [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-09-14 07:01:37,068 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-09-14 07:01:37,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-09-14 07:01:37,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-14 07:01:37,073 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694674897073"}]},"ts":"1694674897073"} 2023-09-14 07:01:37,075 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-09-14 07:01:37,076 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-09-14 07:01:37,077 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a051cb7a700a1a475f31b72b81844542, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2cfa76861414225dbf6d6adaf7934539, UNASSIGN}] 2023-09-14 07:01:37,079 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a051cb7a700a1a475f31b72b81844542, UNASSIGN 2023-09-14 07:01:37,080 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2cfa76861414225dbf6d6adaf7934539, UNASSIGN 2023-09-14 07:01:37,080 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=a051cb7a700a1a475f31b72b81844542, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:37,081 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1694674881097.a051cb7a700a1a475f31b72b81844542.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694674897080"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694674897080"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694674897080"}]},"ts":"1694674897080"} 2023-09-14 07:01:37,081 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=2cfa76861414225dbf6d6adaf7934539, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:37,081 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1694674881097.2cfa76861414225dbf6d6adaf7934539.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694674897081"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694674897081"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694674897081"}]},"ts":"1694674897081"} 2023-09-14 07:01:37,082 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure a051cb7a700a1a475f31b72b81844542, server=jenkins-hbase4.apache.org,37703,1694674856695}] 2023-09-14 07:01:37,083 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 2cfa76861414225dbf6d6adaf7934539, server=jenkins-hbase4.apache.org,41005,1694674856735}] 2023-09-14 07:01:37,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-14 07:01:37,235 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a051cb7a700a1a475f31b72b81844542 2023-09-14 07:01:37,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a051cb7a700a1a475f31b72b81844542, disabling compactions & flushes 2023-09-14 07:01:37,235 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1694674881097.a051cb7a700a1a475f31b72b81844542. 2023-09-14 07:01:37,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1694674881097.a051cb7a700a1a475f31b72b81844542. 2023-09-14 07:01:37,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1694674881097.a051cb7a700a1a475f31b72b81844542. after waiting 0 ms 2023-09-14 07:01:37,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1694674881097.a051cb7a700a1a475f31b72b81844542. 2023-09-14 07:01:37,235 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2cfa76861414225dbf6d6adaf7934539 2023-09-14 07:01:37,239 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2cfa76861414225dbf6d6adaf7934539, disabling compactions & flushes 2023-09-14 07:01:37,239 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1694674881097.2cfa76861414225dbf6d6adaf7934539. 2023-09-14 07:01:37,239 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1694674881097.2cfa76861414225dbf6d6adaf7934539. 2023-09-14 07:01:37,239 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1694674881097.2cfa76861414225dbf6d6adaf7934539. after waiting 0 ms 2023-09-14 07:01:37,239 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1694674881097.2cfa76861414225dbf6d6adaf7934539. 2023-09-14 07:01:37,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemState/a051cb7a700a1a475f31b72b81844542/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-14 07:01:37,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemState/2cfa76861414225dbf6d6adaf7934539/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-14 07:01:37,246 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-14 07:01:37,247 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-14 07:01:37,247 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1694674881097.2cfa76861414225dbf6d6adaf7934539. 2023-09-14 07:01:37,247 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2cfa76861414225dbf6d6adaf7934539: 2023-09-14 07:01:37,247 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1694674881097.a051cb7a700a1a475f31b72b81844542. 2023-09-14 07:01:37,248 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a051cb7a700a1a475f31b72b81844542: 2023-09-14 07:01:37,249 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2cfa76861414225dbf6d6adaf7934539 2023-09-14 07:01:37,250 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=2cfa76861414225dbf6d6adaf7934539, regionState=CLOSED 2023-09-14 07:01:37,250 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a051cb7a700a1a475f31b72b81844542 2023-09-14 07:01:37,250 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1694674881097.2cfa76861414225dbf6d6adaf7934539.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694674897250"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694674897250"}]},"ts":"1694674897250"} 2023-09-14 07:01:37,250 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=a051cb7a700a1a475f31b72b81844542, regionState=CLOSED 2023-09-14 07:01:37,251 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1694674881097.a051cb7a700a1a475f31b72b81844542.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694674897250"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694674897250"}]},"ts":"1694674897250"} 2023-09-14 07:01:37,253 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=38 2023-09-14 07:01:37,253 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 2cfa76861414225dbf6d6adaf7934539, server=jenkins-hbase4.apache.org,41005,1694674856735 in 168 msec 2023-09-14 07:01:37,254 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=37 2023-09-14 07:01:37,254 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure a051cb7a700a1a475f31b72b81844542, server=jenkins-hbase4.apache.org,37703,1694674856695 in 170 msec 2023-09-14 07:01:37,255 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2cfa76861414225dbf6d6adaf7934539, UNASSIGN in 176 msec 2023-09-14 07:01:37,256 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-09-14 07:01:37,256 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a051cb7a700a1a475f31b72b81844542, UNASSIGN in 177 msec 2023-09-14 07:01:37,257 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694674897257"}]},"ts":"1694674897257"} 2023-09-14 07:01:37,258 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-09-14 07:01:37,260 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-09-14 07:01:37,262 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 193 msec 2023-09-14 07:01:37,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-14 07:01:37,375 INFO [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-09-14 07:01:37,376 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-09-14 07:01:37,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-14 07:01:37,380 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-14 07:01:37,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-09-14 07:01:37,381 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-14 07:01:37,383 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35941] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-09-14 07:01:37,386 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemState/a051cb7a700a1a475f31b72b81844542 2023-09-14 07:01:37,386 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemState/2cfa76861414225dbf6d6adaf7934539 2023-09-14 07:01:37,388 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemState/a051cb7a700a1a475f31b72b81844542/cf, FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemState/a051cb7a700a1a475f31b72b81844542/recovered.edits] 2023-09-14 07:01:37,388 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemState/2cfa76861414225dbf6d6adaf7934539/cf, FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemState/2cfa76861414225dbf6d6adaf7934539/recovered.edits] 2023-09-14 07:01:37,390 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-14 07:01:37,390 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-14 07:01:37,390 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-14 07:01:37,390 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-14 07:01:37,391 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-14 07:01:37,391 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-14 07:01:37,392 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-14 07:01:37,392 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-14 07:01:37,392 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-14 07:01:37,392 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-14 07:01:37,392 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 07:01:37,392 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 07:01:37,392 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-14 07:01:37,392 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 07:01:37,392 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-14 07:01:37,392 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 07:01:37,394 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemState/a051cb7a700a1a475f31b72b81844542/cf/5cf20bd13b494fe38ce51fd11d5dcfad to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/archive/data/default/testtb-testExportFileSystemState/a051cb7a700a1a475f31b72b81844542/cf/5cf20bd13b494fe38ce51fd11d5dcfad 2023-09-14 07:01:37,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-14 07:01:37,394 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemState/2cfa76861414225dbf6d6adaf7934539/cf/3163ad6ddb06407284b24d15884c0df3 to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/archive/data/default/testtb-testExportFileSystemState/2cfa76861414225dbf6d6adaf7934539/cf/3163ad6ddb06407284b24d15884c0df3 2023-09-14 07:01:37,398 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemState/a051cb7a700a1a475f31b72b81844542/recovered.edits/9.seqid to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/archive/data/default/testtb-testExportFileSystemState/a051cb7a700a1a475f31b72b81844542/recovered.edits/9.seqid 2023-09-14 07:01:37,398 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemState/2cfa76861414225dbf6d6adaf7934539/recovered.edits/9.seqid to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/archive/data/default/testtb-testExportFileSystemState/2cfa76861414225dbf6d6adaf7934539/recovered.edits/9.seqid 2023-09-14 07:01:37,399 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemState/a051cb7a700a1a475f31b72b81844542 2023-09-14 07:01:37,399 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemState/2cfa76861414225dbf6d6adaf7934539 2023-09-14 07:01:37,399 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-14 07:01:37,399 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-14 07:01:37,400 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-09-14 07:01:37,404 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023091456bf931ea8ce4461b0d8370f854065ad to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023091456bf931ea8ce4461b0d8370f854065ad 2023-09-14 07:01:37,406 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230914f4c2fca2e79f4ddcb3e09c9d12da8cc9 to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230914f4c2fca2e79f4ddcb3e09c9d12da8cc9 2023-09-14 07:01:37,406 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-14 07:01:37,409 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-14 07:01:37,412 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-09-14 07:01:37,414 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-09-14 07:01:37,416 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-14 07:01:37,416 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-09-14 07:01:37,416 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1694674881097.a051cb7a700a1a475f31b72b81844542.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694674897416"}]},"ts":"9223372036854775807"} 2023-09-14 07:01:37,416 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1694674881097.2cfa76861414225dbf6d6adaf7934539.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694674897416"}]},"ts":"9223372036854775807"} 2023-09-14 07:01:37,418 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-14 07:01:37,418 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a051cb7a700a1a475f31b72b81844542, NAME => 'testtb-testExportFileSystemState,,1694674881097.a051cb7a700a1a475f31b72b81844542.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 2cfa76861414225dbf6d6adaf7934539, NAME => 'testtb-testExportFileSystemState,1,1694674881097.2cfa76861414225dbf6d6adaf7934539.', STARTKEY => '1', ENDKEY => ''}] 2023-09-14 07:01:37,418 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-09-14 07:01:37,418 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694674897418"}]},"ts":"9223372036854775807"} 2023-09-14 07:01:37,420 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-09-14 07:01:37,422 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-14 07:01:37,424 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 46 msec 2023-09-14 07:01:37,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-14 07:01:37,495 INFO [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-09-14 07:01:37,504 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-09-14 07:01:37,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-09-14 07:01:37,509 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-09-14 07:01:37,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-09-14 07:01:37,542 INFO [Listener at jenkins-hbase4.apache.org/40843] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=767 (was 758) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2082 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3a740ce4-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-433519906_17 at /127.0.0.1:45752 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (698022672) connection to jenkins-hbase4.apache.org/172.31.14.131:44455 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3a740ce4-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_659945421_1 at /127.0.0.1:52306 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3a740ce4-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_409472800_17 at /127.0.0.1:37272 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_409472800_17 at /127.0.0.1:52320 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3a740ce4-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=927 (was 939), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=211 (was 174) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=8583 (was 8734) 2023-09-14 07:01:37,542 WARN [Listener at jenkins-hbase4.apache.org/40843] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-09-14 07:01:37,566 INFO [Listener at jenkins-hbase4.apache.org/40843] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=767, OpenFileDescriptor=927, MaxFileDescriptor=60000, SystemLoadAverage=211, ProcessCount=167, AvailableMemoryMB=8580 2023-09-14 07:01:37,566 WARN [Listener at jenkins-hbase4.apache.org/40843] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-09-14 07:01:37,569 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-14 07:01:37,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-09-14 07:01:37,574 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-09-14 07:01:37,574 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-09-14 07:01:37,575 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-14 07:01:37,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-14 07:01:37,578 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testConsecutiveExports/2f87abbb5bb7866490ffd5cc901aa69f 2023-09-14 07:01:37,578 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testConsecutiveExports/dcece324dff3caa44d99f937827c7e71 2023-09-14 07:01:37,578 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testConsecutiveExports/2f87abbb5bb7866490ffd5cc901aa69f empty. 2023-09-14 07:01:37,578 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testConsecutiveExports/dcece324dff3caa44d99f937827c7e71 empty. 2023-09-14 07:01:37,579 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testConsecutiveExports/2f87abbb5bb7866490ffd5cc901aa69f 2023-09-14 07:01:37,579 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testConsecutiveExports/dcece324dff3caa44d99f937827c7e71 2023-09-14 07:01:37,579 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-14 07:01:37,592 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-09-14 07:01:37,593 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => dcece324dff3caa44d99f937827c7e71, NAME => 'testtb-testConsecutiveExports,1,1694674897568.dcece324dff3caa44d99f937827c7e71.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp 2023-09-14 07:01:37,593 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2f87abbb5bb7866490ffd5cc901aa69f, NAME => 'testtb-testConsecutiveExports,,1694674897568.2f87abbb5bb7866490ffd5cc901aa69f.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp 2023-09-14 07:01:37,613 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1694674897568.2f87abbb5bb7866490ffd5cc901aa69f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 07:01:37,614 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 2f87abbb5bb7866490ffd5cc901aa69f, disabling compactions & flushes 2023-09-14 07:01:37,614 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1694674897568.2f87abbb5bb7866490ffd5cc901aa69f. 2023-09-14 07:01:37,614 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1694674897568.2f87abbb5bb7866490ffd5cc901aa69f. 2023-09-14 07:01:37,614 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1694674897568.2f87abbb5bb7866490ffd5cc901aa69f. after waiting 0 ms 2023-09-14 07:01:37,614 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1694674897568.2f87abbb5bb7866490ffd5cc901aa69f. 2023-09-14 07:01:37,614 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1694674897568.2f87abbb5bb7866490ffd5cc901aa69f. 2023-09-14 07:01:37,614 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 2f87abbb5bb7866490ffd5cc901aa69f: 2023-09-14 07:01:37,618 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1694674897568.dcece324dff3caa44d99f937827c7e71.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 07:01:37,618 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing dcece324dff3caa44d99f937827c7e71, disabling compactions & flushes 2023-09-14 07:01:37,618 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1694674897568.dcece324dff3caa44d99f937827c7e71. 2023-09-14 07:01:37,618 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1694674897568.dcece324dff3caa44d99f937827c7e71. 2023-09-14 07:01:37,618 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1694674897568.dcece324dff3caa44d99f937827c7e71. after waiting 0 ms 2023-09-14 07:01:37,618 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1694674897568.dcece324dff3caa44d99f937827c7e71. 2023-09-14 07:01:37,618 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1694674897568.dcece324dff3caa44d99f937827c7e71. 2023-09-14 07:01:37,618 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for dcece324dff3caa44d99f937827c7e71: 2023-09-14 07:01:37,621 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-09-14 07:01:37,622 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1694674897568.2f87abbb5bb7866490ffd5cc901aa69f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694674897622"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694674897622"}]},"ts":"1694674897622"} 2023-09-14 07:01:37,622 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1694674897568.dcece324dff3caa44d99f937827c7e71.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694674897622"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694674897622"}]},"ts":"1694674897622"} 2023-09-14 07:01:37,625 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-14 07:01:37,626 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-14 07:01:37,626 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694674897626"}]},"ts":"1694674897626"} 2023-09-14 07:01:37,628 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-09-14 07:01:37,635 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-14 07:01:37,636 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-14 07:01:37,636 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-14 07:01:37,636 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-14 07:01:37,636 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-14 07:01:37,636 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=2f87abbb5bb7866490ffd5cc901aa69f, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=dcece324dff3caa44d99f937827c7e71, ASSIGN}] 2023-09-14 07:01:37,639 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=dcece324dff3caa44d99f937827c7e71, ASSIGN 2023-09-14 07:01:37,639 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=2f87abbb5bb7866490ffd5cc901aa69f, ASSIGN 2023-09-14 07:01:37,640 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=dcece324dff3caa44d99f937827c7e71, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41005,1694674856735; forceNewPlan=false, retain=false 2023-09-14 07:01:37,640 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=2f87abbb5bb7866490ffd5cc901aa69f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37703,1694674856695; forceNewPlan=false, retain=false 2023-09-14 07:01:37,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-14 07:01:37,790 INFO [jenkins-hbase4:33055] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-14 07:01:37,793 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=dcece324dff3caa44d99f937827c7e71, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:37,793 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=2f87abbb5bb7866490ffd5cc901aa69f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:37,793 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1694674897568.dcece324dff3caa44d99f937827c7e71.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694674897793"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694674897793"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694674897793"}]},"ts":"1694674897793"} 2023-09-14 07:01:37,793 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1694674897568.2f87abbb5bb7866490ffd5cc901aa69f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694674897793"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694674897793"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694674897793"}]},"ts":"1694674897793"} 2023-09-14 07:01:37,795 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure dcece324dff3caa44d99f937827c7e71, server=jenkins-hbase4.apache.org,41005,1694674856735}] 2023-09-14 07:01:37,796 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure 2f87abbb5bb7866490ffd5cc901aa69f, server=jenkins-hbase4.apache.org,37703,1694674856695}] 2023-09-14 07:01:37,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-14 07:01:37,950 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1694674897568.dcece324dff3caa44d99f937827c7e71. 2023-09-14 07:01:37,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dcece324dff3caa44d99f937827c7e71, NAME => 'testtb-testConsecutiveExports,1,1694674897568.dcece324dff3caa44d99f937827c7e71.', STARTKEY => '1', ENDKEY => ''} 2023-09-14 07:01:37,951 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1694674897568.2f87abbb5bb7866490ffd5cc901aa69f. 2023-09-14 07:01:37,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2f87abbb5bb7866490ffd5cc901aa69f, NAME => 'testtb-testConsecutiveExports,,1694674897568.2f87abbb5bb7866490ffd5cc901aa69f.', STARTKEY => '', ENDKEY => '1'} 2023-09-14 07:01:37,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1694674897568.dcece324dff3caa44d99f937827c7e71. service=AccessControlService 2023-09-14 07:01:37,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1694674897568.2f87abbb5bb7866490ffd5cc901aa69f. service=AccessControlService 2023-09-14 07:01:37,951 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-14 07:01:37,951 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-14 07:01:37,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports dcece324dff3caa44d99f937827c7e71 2023-09-14 07:01:37,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 2f87abbb5bb7866490ffd5cc901aa69f 2023-09-14 07:01:37,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1694674897568.dcece324dff3caa44d99f937827c7e71.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 07:01:37,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1694674897568.2f87abbb5bb7866490ffd5cc901aa69f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 07:01:37,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for dcece324dff3caa44d99f937827c7e71 2023-09-14 07:01:37,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2f87abbb5bb7866490ffd5cc901aa69f 2023-09-14 07:01:37,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for dcece324dff3caa44d99f937827c7e71 2023-09-14 07:01:37,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2f87abbb5bb7866490ffd5cc901aa69f 2023-09-14 07:01:37,953 INFO [StoreOpener-2f87abbb5bb7866490ffd5cc901aa69f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2f87abbb5bb7866490ffd5cc901aa69f 2023-09-14 07:01:37,953 INFO [StoreOpener-dcece324dff3caa44d99f937827c7e71-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region dcece324dff3caa44d99f937827c7e71 2023-09-14 07:01:37,954 DEBUG [StoreOpener-2f87abbb5bb7866490ffd5cc901aa69f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testConsecutiveExports/2f87abbb5bb7866490ffd5cc901aa69f/cf 2023-09-14 07:01:37,954 DEBUG [StoreOpener-2f87abbb5bb7866490ffd5cc901aa69f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testConsecutiveExports/2f87abbb5bb7866490ffd5cc901aa69f/cf 2023-09-14 07:01:37,954 DEBUG [StoreOpener-dcece324dff3caa44d99f937827c7e71-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testConsecutiveExports/dcece324dff3caa44d99f937827c7e71/cf 2023-09-14 07:01:37,954 DEBUG [StoreOpener-dcece324dff3caa44d99f937827c7e71-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testConsecutiveExports/dcece324dff3caa44d99f937827c7e71/cf 2023-09-14 07:01:37,954 INFO [StoreOpener-2f87abbb5bb7866490ffd5cc901aa69f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2f87abbb5bb7866490ffd5cc901aa69f columnFamilyName cf 2023-09-14 07:01:37,954 INFO [StoreOpener-dcece324dff3caa44d99f937827c7e71-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dcece324dff3caa44d99f937827c7e71 columnFamilyName cf 2023-09-14 07:01:37,956 INFO [StoreOpener-dcece324dff3caa44d99f937827c7e71-1] regionserver.HStore(310): Store=dcece324dff3caa44d99f937827c7e71/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-14 07:01:37,956 INFO [StoreOpener-2f87abbb5bb7866490ffd5cc901aa69f-1] regionserver.HStore(310): Store=2f87abbb5bb7866490ffd5cc901aa69f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-14 07:01:37,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testConsecutiveExports/2f87abbb5bb7866490ffd5cc901aa69f 2023-09-14 07:01:37,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testConsecutiveExports/dcece324dff3caa44d99f937827c7e71 2023-09-14 07:01:37,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testConsecutiveExports/2f87abbb5bb7866490ffd5cc901aa69f 2023-09-14 07:01:37,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testConsecutiveExports/dcece324dff3caa44d99f937827c7e71 2023-09-14 07:01:37,960 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2f87abbb5bb7866490ffd5cc901aa69f 2023-09-14 07:01:37,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for dcece324dff3caa44d99f937827c7e71 2023-09-14 07:01:37,962 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testConsecutiveExports/2f87abbb5bb7866490ffd5cc901aa69f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-14 07:01:37,963 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2f87abbb5bb7866490ffd5cc901aa69f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68630271, jitterRate=0.02267073094844818}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-14 07:01:37,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2f87abbb5bb7866490ffd5cc901aa69f: 2023-09-14 07:01:37,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testConsecutiveExports/dcece324dff3caa44d99f937827c7e71/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-14 07:01:37,963 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened dcece324dff3caa44d99f937827c7e71; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71842902, jitterRate=0.07054266333580017}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-14 07:01:37,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for dcece324dff3caa44d99f937827c7e71: 2023-09-14 07:01:37,964 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1694674897568.2f87abbb5bb7866490ffd5cc901aa69f., pid=46, masterSystemTime=1694674897948 2023-09-14 07:01:37,964 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1694674897568.dcece324dff3caa44d99f937827c7e71., pid=45, masterSystemTime=1694674897947 2023-09-14 07:01:37,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1694674897568.2f87abbb5bb7866490ffd5cc901aa69f. 2023-09-14 07:01:37,966 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1694674897568.2f87abbb5bb7866490ffd5cc901aa69f. 2023-09-14 07:01:37,966 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=2f87abbb5bb7866490ffd5cc901aa69f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:37,966 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1694674897568.2f87abbb5bb7866490ffd5cc901aa69f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694674897966"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694674897966"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694674897966"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694674897966"}]},"ts":"1694674897966"} 2023-09-14 07:01:37,966 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1694674897568.dcece324dff3caa44d99f937827c7e71. 2023-09-14 07:01:37,967 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1694674897568.dcece324dff3caa44d99f937827c7e71. 2023-09-14 07:01:37,967 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=dcece324dff3caa44d99f937827c7e71, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:37,967 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1694674897568.dcece324dff3caa44d99f937827c7e71.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694674897967"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694674897967"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694674897967"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694674897967"}]},"ts":"1694674897967"} 2023-09-14 07:01:37,971 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=43 2023-09-14 07:01:37,971 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure 2f87abbb5bb7866490ffd5cc901aa69f, server=jenkins-hbase4.apache.org,37703,1694674856695 in 172 msec 2023-09-14 07:01:37,971 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=44 2023-09-14 07:01:37,972 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure dcece324dff3caa44d99f937827c7e71, server=jenkins-hbase4.apache.org,41005,1694674856735 in 174 msec 2023-09-14 07:01:37,972 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=2f87abbb5bb7866490ffd5cc901aa69f, ASSIGN in 335 msec 2023-09-14 07:01:37,973 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=42 2023-09-14 07:01:37,973 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=dcece324dff3caa44d99f937827c7e71, ASSIGN in 336 msec 2023-09-14 07:01:37,974 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-14 07:01:37,974 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694674897974"}]},"ts":"1694674897974"} 2023-09-14 07:01:37,976 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-09-14 07:01:37,979 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-09-14 07:01:37,979 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-09-14 07:01:37,981 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35941] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-14 07:01:37,983 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 07:01:37,983 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 07:01:37,983 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 07:01:37,983 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 07:01:37,984 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-14 07:01:37,984 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-14 07:01:37,984 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-14 07:01:37,985 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-14 07:01:37,986 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 415 msec 2023-09-14 07:01:38,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-14 07:01:38,179 INFO [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-09-14 07:01:38,182 DEBUG [Listener at jenkins-hbase4.apache.org/40843] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-14 07:01:38,182 DEBUG [Listener at jenkins-hbase4.apache.org/40843] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1694674897568.2f87abbb5bb7866490ffd5cc901aa69f. 2023-09-14 07:01:38,183 INFO [Listener at jenkins-hbase4.apache.org/40843] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-14 07:01:38,195 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-14 07:01:38,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694674898195 (current time:1694674898195). 2023-09-14 07:01:38,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-14 07:01:38,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] zookeeper.ReadOnlyZKClient(139): Connect 0x120ecfd6 to 127.0.0.1:52295 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 07:01:38,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@84e1b1b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 07:01:38,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 07:01:38,210 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53306, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 07:01:38,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x120ecfd6 to 127.0.0.1:52295 2023-09-14 07:01:38,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 07:01:38,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] zookeeper.ReadOnlyZKClient(139): Connect 0x518d8deb to 127.0.0.1:52295 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 07:01:38,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@35998873, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 07:01:38,222 DEBUG [hconnection-0x4df7db18-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 07:01:38,224 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53316, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 07:01:38,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 07:01:38,231 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32974, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 07:01:38,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x518d8deb to 127.0.0.1:52295 2023-09-14 07:01:38,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 07:01:38,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-14 07:01:38,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-14 07:01:38,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-14 07:01:38,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-14 07:01:38,236 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-14 07:01:38,237 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1694675498237 2023-09-14 07:01:38,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-14 07:01:38,237 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-14 07:01:38,238 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-14 07:01:38,239 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-14 07:01:38,240 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-14 07:01:38,240 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-14 07:01:38,241 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-09-14 07:01:38,242 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-14 07:01:38,243 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1694675498243 2023-09-14 07:01:38,258 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,259 INFO [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-09-14 07:01:38,259 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 07:01:38,260 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-09-14 07:01:38,260 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-14 07:01:38,261 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,261 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,263 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:01:38,263 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:01:38,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:01:38,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:01:38,263 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:01:38,263 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:38,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:01:38,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:01:38,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:01:38,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:01:38,264 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:38,264 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:38,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,264 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:38,264 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-14 07:01:38,264 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,265 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,265 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-14 07:01:38,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-14 07:01:38,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,265 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-14 07:01:38,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-14 07:01:38,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,265 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-14 07:01:38,265 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-14 07:01:38,265 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,265 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,265 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-14 07:01:38,266 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-14 07:01:38,266 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 07:01:38,265 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,267 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-14 07:01:38,267 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-14 07:01:38,267 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-14 07:01:38,267 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41005,1694674856735' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-14 07:01:38,266 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 07:01:38,267 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 07:01:38,268 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-14 07:01:38,269 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-14 07:01:38,272 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-14 07:01:38,272 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-14 07:01:38,272 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35941,1694674856649' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-14 07:01:38,272 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37703,1694674856695' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-14 07:01:38,273 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:38,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:38,273 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:01:38,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:01:38,274 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:38,274 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,274 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,274 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,275 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 07:01:38,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:01:38,275 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,275 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 07:01:38,275 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,275 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 07:01:38,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:01:38,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:38,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:38,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:38,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:01:38,277 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41005,1694674856735' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-14 07:01:38,277 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3a11601[Count = 1] remaining members to acquire global barrier 2023-09-14 07:01:38,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:38,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:01:38,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:01:38,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:01:38,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:01:38,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:38,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:38,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:38,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:01:38,279 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37703,1694674856695' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-14 07:01:38,279 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3a11601[Count = 0] remaining members to acquire global barrier 2023-09-14 07:01:38,279 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-14 07:01:38,279 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,280 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,280 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,280 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,280 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-14 07:01:38,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,280 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:38,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,280 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-14 07:01:38,280 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-14 07:01:38,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,281 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35941,1694674856649' in zk 2023-09-14 07:01:38,281 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-14 07:01:38,281 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:38,281 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-14 07:01:38,281 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-14 07:01:38,281 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-14 07:01:38,281 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-14 07:01:38,281 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1694674897568.dcece324dff3caa44d99f937827c7e71. 2023-09-14 07:01:38,281 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1694674897568.2f87abbb5bb7866490ffd5cc901aa69f. 2023-09-14 07:01:38,281 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1694674897568.dcece324dff3caa44d99f937827c7e71. started... 2023-09-14 07:01:38,281 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1694674897568.2f87abbb5bb7866490ffd5cc901aa69f. started... 2023-09-14 07:01:38,281 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-14 07:01:38,282 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2f87abbb5bb7866490ffd5cc901aa69f: 2023-09-14 07:01:38,282 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dcece324dff3caa44d99f937827c7e71: 2023-09-14 07:01:38,283 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1694674897568.2f87abbb5bb7866490ffd5cc901aa69f.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,283 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-14 07:01:38,283 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1694674897568.dcece324dff3caa44d99f937827c7e71.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,283 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-14 07:01:38,283 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-14 07:01:38,283 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-14 07:01:38,290 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-14 07:01:38,290 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 07:01:38,290 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-14 07:01:38,296 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1694674897568.dcece324dff3caa44d99f937827c7e71. completed. 2023-09-14 07:01:38,296 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1694674897568.dcece324dff3caa44d99f937827c7e71. 2023-09-14 07:01:38,296 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-14 07:01:38,297 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-14 07:01:38,296 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1694674897568.2f87abbb5bb7866490ffd5cc901aa69f. completed. 2023-09-14 07:01:38,297 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:38,297 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1694674897568.2f87abbb5bb7866490ffd5cc901aa69f. 2023-09-14 07:01:38,297 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-14 07:01:38,297 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-14 07:01:38,297 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-14 07:01:38,297 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,41005,1694674856735' in zk 2023-09-14 07:01:38,297 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:38,297 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-14 07:01:38,297 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37703,1694674856695' in zk 2023-09-14 07:01:38,299 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:38,299 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-14 07:01:38,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:38,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:01:38,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:01:38,299 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 07:01:38,299 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:38,299 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-14 07:01:38,299 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-14 07:01:38,301 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 07:01:38,301 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-14 07:01:38,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:01:38,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:01:38,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:38,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:38,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:38,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:01:38,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:38,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:38,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:38,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,41005,1694674856735': 2023-09-14 07:01:38,307 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41005,1694674856735' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-14 07:01:38,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:38,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:01:38,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:01:38,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:01:38,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:01:38,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:38,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:38,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:38,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:01:38,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:38,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:38,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:38,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,37703,1694674856695': 2023-09-14 07:01:38,311 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37703,1694674856695' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-14 07:01:38,311 INFO [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-09-14 07:01:38,311 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-14 07:01:38,311 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-14 07:01:38,311 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,311 INFO [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-14 07:01:38,314 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,314 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,314 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:01:38,314 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,314 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:01:38,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:01:38,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,314 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:01:38,314 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:38,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,314 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:01:38,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:01:38,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:01:38,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:01:38,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:01:38,315 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:38,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:01:38,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:01:38,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:01:38,315 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:38,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:01:38,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:38,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:38,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:38,317 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:38,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:01:38,318 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:38,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,318 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:38,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:38,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:38,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:38,321 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:38,321 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,321 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:38,321 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:01:38,321 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:01:38,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:01:38,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:01:38,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:01:38,321 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:01:38,321 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 07:01:38,321 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:38,321 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:01:38,322 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:01:38,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:01:38,321 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:01:38,321 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:01:38,323 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-14 07:01:38,323 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:38,323 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,322 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:01:38,323 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-14 07:01:38,323 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:01:38,323 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:38,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:01:38,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:01:38,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:01:38,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:01:38,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:01:38,323 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:38,324 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,324 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,324 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-14 07:01:38,331 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,331 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,339 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-14 07:01:38,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-14 07:01:38,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-14 07:01:38,340 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-14 07:01:38,351 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,352 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-14 07:01:38,352 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,353 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-14 07:01:38,353 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1694674898237Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1694674898331 (+94 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1694674898331Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1694674898331Writing data manifest for emptySnaptb0-testConsecutiveExports at 1694674898334 (+3 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1694674898345 (+11 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1694674898352 (+7 ms) 2023-09-14 07:01:38,358 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-14 07:01:38,360 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 120 msec 2023-09-14 07:01:38,540 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-14 07:01:38,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-14 07:01:38,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-14 07:01:38,544 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37703] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1694674897568.2f87abbb5bb7866490ffd5cc901aa69f. with WAL disabled. Data may be lost in the event of a crash. 2023-09-14 07:01:38,546 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41005] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1694674897568.dcece324dff3caa44d99f937827c7e71. with WAL disabled. Data may be lost in the event of a crash. 2023-09-14 07:01:38,549 DEBUG [Listener at jenkins-hbase4.apache.org/40843] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-14 07:01:38,549 DEBUG [Listener at jenkins-hbase4.apache.org/40843] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1694674897568.2f87abbb5bb7866490ffd5cc901aa69f. 2023-09-14 07:01:38,550 INFO [Listener at jenkins-hbase4.apache.org/40843] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-14 07:01:38,559 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-14 07:01:38,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694674898559 (current time:1694674898559). 2023-09-14 07:01:38,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-14 07:01:38,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] zookeeper.ReadOnlyZKClient(139): Connect 0x5f62e6d7 to 127.0.0.1:52295 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 07:01:38,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12cea662, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 07:01:38,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 07:01:38,576 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53320, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 07:01:38,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5f62e6d7 to 127.0.0.1:52295 2023-09-14 07:01:38,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 07:01:38,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] zookeeper.ReadOnlyZKClient(139): Connect 0x000592ef to 127.0.0.1:52295 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 07:01:38,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@48998866, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 07:01:38,586 DEBUG [hconnection-0x2f03caa1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 07:01:38,588 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53330, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 07:01:38,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 07:01:38,593 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32980, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 07:01:38,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x000592ef to 127.0.0.1:52295 2023-09-14 07:01:38,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 07:01:38,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-14 07:01:38,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-14 07:01:38,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-14 07:01:38,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-14 07:01:38,598 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-14 07:01:38,599 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1694675498599 2023-09-14 07:01:38,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-14 07:01:38,599 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-14 07:01:38,601 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-14 07:01:38,601 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-14 07:01:38,602 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-14 07:01:38,602 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-14 07:01:38,603 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-09-14 07:01:38,604 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-14 07:01:38,605 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1694675498605 2023-09-14 07:01:38,618 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-09-14 07:01:38,618 INFO [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-09-14 07:01:38,618 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 07:01:38,619 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-09-14 07:01:38,619 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-14 07:01:38,620 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-14 07:01:38,620 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-14 07:01:38,622 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:01:38,622 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:01:38,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:01:38,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:01:38,622 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:38,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:01:38,622 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:01:38,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:01:38,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:01:38,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:01:38,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-14 07:01:38,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-14 07:01:38,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-14 07:01:38,623 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:38,623 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:38,623 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-14 07:01:38,624 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-14 07:01:38,624 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-14 07:01:38,624 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:38,624 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-14 07:01:38,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-14 07:01:38,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-14 07:01:38,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-14 07:01:38,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-14 07:01:38,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-14 07:01:38,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-14 07:01:38,624 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-14 07:01:38,624 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-14 07:01:38,624 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-14 07:01:38,625 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-14 07:01:38,625 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-14 07:01:38,625 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-14 07:01:38,625 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-14 07:01:38,625 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-14 07:01:38,625 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 07:01:38,625 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-14 07:01:38,626 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-14 07:01:38,626 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 07:01:38,625 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 07:01:38,627 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-14 07:01:38,628 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-14 07:01:38,626 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-14 07:01:38,628 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35941,1694674856649' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-14 07:01:38,628 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-14 07:01:38,629 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-14 07:01:38,629 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41005,1694674856735' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-14 07:01:38,629 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37703,1694674856695' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-14 07:01:38,630 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:38,630 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-14 07:01:38,630 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-14 07:01:38,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:38,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:01:38,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:01:38,631 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-14 07:01:38,631 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:38,631 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-14 07:01:38,631 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-14 07:01:38,631 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 07:01:38,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:01:38,631 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 07:01:38,631 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-14 07:01:38,631 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 07:01:38,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:01:38,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-14 07:01:38,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:38,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:38,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:38,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:01:38,633 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37703,1694674856695' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-14 07:01:38,634 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12a05dae[Count = 1] remaining members to acquire global barrier 2023-09-14 07:01:38,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:38,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:01:38,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:01:38,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:01:38,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:01:38,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-14 07:01:38,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:38,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:38,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:38,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:01:38,636 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41005,1694674856735' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-14 07:01:38,636 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12a05dae[Count = 0] remaining members to acquire global barrier 2023-09-14 07:01:38,636 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-14 07:01:38,636 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-14 07:01:38,638 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-14 07:01:38,638 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-14 07:01:38,638 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-14 07:01:38,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-14 07:01:38,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-14 07:01:38,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-14 07:01:38,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-14 07:01:38,639 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-14 07:01:38,639 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:38,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-14 07:01:38,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-14 07:01:38,639 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-14 07:01:38,639 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-14 07:01:38,639 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1694674897568.dcece324dff3caa44d99f937827c7e71. 2023-09-14 07:01:38,639 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-14 07:01:38,639 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-14 07:01:38,639 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-14 07:01:38,639 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35941,1694674856649' in zk 2023-09-14 07:01:38,639 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1694674897568.dcece324dff3caa44d99f937827c7e71. started... 2023-09-14 07:01:38,639 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:38,640 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-14 07:01:38,640 INFO [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] regionserver.HRegion(2745): Flushing dcece324dff3caa44d99f937827c7e71 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-14 07:01:38,642 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-14 07:01:38,642 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 07:01:38,642 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-14 07:01:38,648 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-14 07:01:38,649 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-14 07:01:38,649 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1694674897568.2f87abbb5bb7866490ffd5cc901aa69f. 2023-09-14 07:01:38,649 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1694674897568.2f87abbb5bb7866490ffd5cc901aa69f. started... 2023-09-14 07:01:38,649 INFO [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2f87abbb5bb7866490ffd5cc901aa69f 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-14 07:01:38,683 INFO [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309149ed7c63a59164278b59a7ab960a99b63 to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202309149ed7c63a59164278b59a7ab960a99b63 2023-09-14 07:01:38,687 INFO [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230914cb7d9f4fc6734e0aa8e41c3d2347cd02 to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230914cb7d9f4fc6734e0aa8e41c3d2347cd02 2023-09-14 07:01:38,701 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-14 07:01:38,702 INFO [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testConsecutiveExports/dcece324dff3caa44d99f937827c7e71/.tmp/cf/ccd9aaf5ff7f4a4593c1a4390ca4dcc1 2023-09-14 07:01:38,702 INFO [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testConsecutiveExports/2f87abbb5bb7866490ffd5cc901aa69f/.tmp/cf/2221f175a1c04190ad6667a100aad159 2023-09-14 07:01:38,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-14 07:01:38,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-14 07:01:38,703 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-14 07:01:38,708 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testConsecutiveExports/dcece324dff3caa44d99f937827c7e71/.tmp/cf/ccd9aaf5ff7f4a4593c1a4390ca4dcc1 as hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testConsecutiveExports/dcece324dff3caa44d99f937827c7e71/cf/ccd9aaf5ff7f4a4593c1a4390ca4dcc1 2023-09-14 07:01:38,708 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testConsecutiveExports/2f87abbb5bb7866490ffd5cc901aa69f/.tmp/cf/2221f175a1c04190ad6667a100aad159 as hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testConsecutiveExports/2f87abbb5bb7866490ffd5cc901aa69f/cf/2221f175a1c04190ad6667a100aad159 2023-09-14 07:01:38,713 INFO [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testConsecutiveExports/dcece324dff3caa44d99f937827c7e71/cf/ccd9aaf5ff7f4a4593c1a4390ca4dcc1, entries=46, sequenceid=6, filesize=12.5 K 2023-09-14 07:01:38,714 INFO [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testConsecutiveExports/2f87abbb5bb7866490ffd5cc901aa69f/cf/2221f175a1c04190ad6667a100aad159, entries=4, sequenceid=6, filesize=5.6 K 2023-09-14 07:01:38,714 INFO [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 2f87abbb5bb7866490ffd5cc901aa69f in 65ms, sequenceid=6, compaction requested=false 2023-09-14 07:01:38,715 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-14 07:01:38,715 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2f87abbb5bb7866490ffd5cc901aa69f: 2023-09-14 07:01:38,715 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1694674897568.2f87abbb5bb7866490ffd5cc901aa69f.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-14 07:01:38,715 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-14 07:01:38,715 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testConsecutiveExports/2f87abbb5bb7866490ffd5cc901aa69f/cf/2221f175a1c04190ad6667a100aad159] hfiles 2023-09-14 07:01:38,715 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testConsecutiveExports/2f87abbb5bb7866490ffd5cc901aa69f/cf/2221f175a1c04190ad6667a100aad159 for snapshot=snaptb0-testConsecutiveExports 2023-09-14 07:01:38,716 INFO [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for dcece324dff3caa44d99f937827c7e71 in 76ms, sequenceid=6, compaction requested=false 2023-09-14 07:01:38,718 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dcece324dff3caa44d99f937827c7e71: 2023-09-14 07:01:38,718 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1694674897568.dcece324dff3caa44d99f937827c7e71.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-14 07:01:38,718 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-14 07:01:38,718 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testConsecutiveExports/dcece324dff3caa44d99f937827c7e71/cf/ccd9aaf5ff7f4a4593c1a4390ca4dcc1] hfiles 2023-09-14 07:01:38,718 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testConsecutiveExports/dcece324dff3caa44d99f937827c7e71/cf/ccd9aaf5ff7f4a4593c1a4390ca4dcc1 for snapshot=snaptb0-testConsecutiveExports 2023-09-14 07:01:38,731 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1694674897568.2f87abbb5bb7866490ffd5cc901aa69f. completed. 2023-09-14 07:01:38,731 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1694674897568.2f87abbb5bb7866490ffd5cc901aa69f. 2023-09-14 07:01:38,731 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-14 07:01:38,731 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-14 07:01:38,731 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:38,731 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-14 07:01:38,731 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37703,1694674856695' in zk 2023-09-14 07:01:38,732 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1694674897568.dcece324dff3caa44d99f937827c7e71. completed. 2023-09-14 07:01:38,732 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1694674897568.dcece324dff3caa44d99f937827c7e71. 2023-09-14 07:01:38,732 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-14 07:01:38,732 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-14 07:01:38,732 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:38,733 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-14 07:01:38,733 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,41005,1694674856735' in zk 2023-09-14 07:01:38,733 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:38,733 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-14 07:01:38,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:38,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:01:38,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:01:38,733 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 07:01:38,733 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-14 07:01:38,735 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:38,735 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-14 07:01:38,735 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 07:01:38,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:01:38,735 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-14 07:01:38,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:01:38,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-14 07:01:38,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:38,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:38,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:38,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:01:38,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-14 07:01:38,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:38,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:38,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:38,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,37703,1694674856695': 2023-09-14 07:01:38,739 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37703,1694674856695' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-14 07:01:38,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:38,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:01:38,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:01:38,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:01:38,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:01:38,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-14 07:01:38,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:38,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:38,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:38,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:01:38,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-14 07:01:38,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:38,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:38,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:38,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,41005,1694674856735': 2023-09-14 07:01:38,742 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41005,1694674856735' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-14 07:01:38,742 INFO [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-09-14 07:01:38,742 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-14 07:01:38,742 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-14 07:01:38,742 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-09-14 07:01:38,742 INFO [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-14 07:01:38,744 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-14 07:01:38,744 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-14 07:01:38,745 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-14 07:01:38,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-14 07:01:38,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-14 07:01:38,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-14 07:01:38,744 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-14 07:01:38,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-14 07:01:38,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-14 07:01:38,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:01:38,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:01:38,745 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:01:38,745 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:01:38,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-14 07:01:38,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:01:38,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:01:38,745 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:38,744 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:01:38,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:01:38,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:01:38,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:01:38,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-14 07:01:38,746 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:38,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-14 07:01:38,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-14 07:01:38,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:01:38,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:01:38,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-14 07:01:38,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:01:38,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-14 07:01:38,746 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:38,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-14 07:01:38,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:38,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:38,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:38,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:01:38,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-14 07:01:38,750 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:38,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:38,750 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:38,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:38,750 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:38,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:38,756 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:38,756 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-14 07:01:38,756 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:01:38,756 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:38,756 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:01:38,756 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:01:38,757 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:01:38,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:01:38,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:01:38,757 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 07:01:38,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:01:38,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:01:38,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:01:38,758 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:01:38,756 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:38,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:01:38,757 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:01:38,757 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-09-14 07:01:38,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:01:38,759 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-14 07:01:38,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:01:38,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:01:38,759 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-14 07:01:38,758 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-14 07:01:38,759 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-14 07:01:38,759 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:01:38,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:01:38,759 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-14 07:01:38,759 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:01:38,759 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:01:38,759 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-14 07:01:38,759 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-14 07:01:38,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:01:38,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:01:38,760 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202309149ed7c63a59164278b59a7ab960a99b63, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230914cb7d9f4fc6734e0aa8e41c3d2347cd02] mob files 2023-09-14 07:01:38,760 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202309149ed7c63a59164278b59a7ab960a99b63 2023-09-14 07:01:38,760 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230914cb7d9f4fc6734e0aa8e41c3d2347cd02 2023-09-14 07:01:38,771 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-09-14 07:01:38,771 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-14 07:01:38,796 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-14 07:01:38,797 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-14 07:01:38,797 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-14 07:01:38,798 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-14 07:01:38,798 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1694674898599Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1694674898771 (+172 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1694674898771Loading Region manifests for snaptb0-testConsecutiveExports at 1694674898771Writing data manifest for snaptb0-testConsecutiveExports at 1694674898775 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1694674898788 (+13 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1694674898797 (+9 ms) 2023-09-14 07:01:38,801 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-14 07:01:38,802 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 201 msec 2023-09-14 07:01:38,903 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-14 07:01:38,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-14 07:01:38,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-14 07:01:38,905 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/local-export-1694674898905 2023-09-14 07:01:38,905 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/local-export-1694674898905, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/local-export-1694674898905, srcFsUri=hdfs://localhost:44283, srcDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04 2023-09-14 07:01:38,927 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44283, inputRoot=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04 2023-09-14 07:01:38,927 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@41ba2256, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/local-export-1694674898905, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/local-export-1694674898905/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-14 07:01:38,927 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44283, inputRoot=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04, snapshotDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-14 07:01:38,935 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/local-export-1694674898905/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-14 07:01:38,947 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-14 07:01:38,947 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-14 07:01:38,947 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-14 07:01:38,948 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-14 07:01:39,824 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/hadoop-1396066926543148078.jar 2023-09-14 07:01:39,824 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-14 07:01:39,825 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-14 07:01:39,891 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/hadoop-762729781310082064.jar 2023-09-14 07:01:39,891 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-14 07:01:39,892 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-14 07:01:39,892 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-14 07:01:39,893 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-14 07:01:39,893 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-14 07:01:39,893 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-14 07:01:39,894 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-14 07:01:39,894 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-14 07:01:39,894 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-14 07:01:39,895 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-14 07:01:39,895 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-14 07:01:39,896 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-14 07:01:39,896 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-14 07:01:39,896 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-14 07:01:39,896 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-14 07:01:39,897 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-14 07:01:39,898 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 07:01:39,898 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 07:01:39,899 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-14 07:01:39,899 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 07:01:39,899 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 07:01:39,900 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-14 07:01:39,900 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-14 07:01:40,258 WARN [Listener at jenkins-hbase4.apache.org/40843] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-14 07:01:40,261 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-14 07:01:40,263 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-14 07:01:41,572 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-14 07:01:41,572 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-14 07:01:41,575 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694674863103_0002_000001 (auth:SIMPLE) 2023-09-14 07:01:42,488 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694674863103_0003_000001 (auth:SIMPLE) 2023-09-14 07:01:42,822 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-14 07:01:46,237 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694674863103_0003_000001 (auth:SIMPLE) 2023-09-14 07:01:48,457 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694674863103_0003_000001 (auth:SIMPLE) 2023-09-14 07:01:50,812 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694674863103_0003_000001 (auth:SIMPLE) 2023-09-14 07:01:52,449 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-14 07:01:52,450 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-14 07:01:52,454 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-14 07:01:52,454 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-14 07:01:52,455 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-14 07:01:52,455 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_409472800_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-14 07:01:52,458 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(367): hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-14 07:01:52,458 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(367): hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-14 07:01:52,458 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@211075eb in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/local-export-1694674898905/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/local-export-1694674898905/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-14 07:01:52,458 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/local-export-1694674898905/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-14 07:01:52,458 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/local-export-1694674898905/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-14 07:01:52,459 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/local-export-1694674898905, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/local-export-1694674898905, srcFsUri=hdfs://localhost:44283, srcDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04 2023-09-14 07:01:52,481 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44283, inputRoot=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04 2023-09-14 07:01:52,481 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@4c7c91e1, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/local-export-1694674898905, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/local-export-1694674898905/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-14 07:01:52,481 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44283, inputRoot=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04, snapshotDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-14 07:01:52,492 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/local-export-1694674898905/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-14 07:01:52,504 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-14 07:01:52,504 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-14 07:01:52,505 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-14 07:01:52,505 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-14 07:01:53,377 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/hadoop-7425497526139796940.jar 2023-09-14 07:01:53,377 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-14 07:01:53,378 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-14 07:01:53,444 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/hadoop-8615874864547590141.jar 2023-09-14 07:01:53,444 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-14 07:01:53,445 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-14 07:01:53,445 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-14 07:01:53,446 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-14 07:01:53,446 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-14 07:01:53,446 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-14 07:01:53,447 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-14 07:01:53,447 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-14 07:01:53,447 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-14 07:01:53,448 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-14 07:01:53,448 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-14 07:01:53,449 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-14 07:01:53,449 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-14 07:01:53,449 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-14 07:01:53,449 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-14 07:01:53,450 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-14 07:01:53,451 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 07:01:53,451 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 07:01:53,452 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-14 07:01:53,452 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 07:01:53,452 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 07:01:53,453 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-14 07:01:53,453 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-14 07:01:53,807 WARN [Listener at jenkins-hbase4.apache.org/40843] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-14 07:01:53,809 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-14 07:01:53,811 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-14 07:01:56,984 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-14 07:01:56,984 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-14 07:01:56,986 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694674863103_0003_000001 (auth:SIMPLE) 2023-09-14 07:01:57,584 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694674863103_0004_000001 (auth:SIMPLE) 2023-09-14 07:02:01,300 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694674863103_0004_000001 (auth:SIMPLE) 2023-09-14 07:02:03,507 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694674863103_0004_000001 (auth:SIMPLE) 2023-09-14 07:02:05,734 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694674863103_0004_000001 (auth:SIMPLE) 2023-09-14 07:02:06,987 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-14 07:02:06,988 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-14 07:02:06,991 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-14 07:02:06,992 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-14 07:02:06,992 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-14 07:02:06,992 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_409472800_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-14 07:02:06,995 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(367): hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-14 07:02:06,995 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(367): hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-14 07:02:06,995 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@211075eb in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/local-export-1694674898905/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/local-export-1694674898905/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-14 07:02:06,995 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/local-export-1694674898905/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-14 07:02:06,996 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/local-export-1694674898905/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-14 07:02:07,009 INFO [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-09-14 07:02:07,009 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-09-14 07:02:07,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-09-14 07:02:07,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-14 07:02:07,013 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694674927013"}]},"ts":"1694674927013"} 2023-09-14 07:02:07,015 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-09-14 07:02:07,017 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-09-14 07:02:07,017 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=2f87abbb5bb7866490ffd5cc901aa69f, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=dcece324dff3caa44d99f937827c7e71, UNASSIGN}] 2023-09-14 07:02:07,019 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=2f87abbb5bb7866490ffd5cc901aa69f, UNASSIGN 2023-09-14 07:02:07,020 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=dcece324dff3caa44d99f937827c7e71, UNASSIGN 2023-09-14 07:02:07,020 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=2f87abbb5bb7866490ffd5cc901aa69f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:07,020 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=dcece324dff3caa44d99f937827c7e71, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:07,020 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1694674897568.2f87abbb5bb7866490ffd5cc901aa69f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694674927020"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694674927020"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694674927020"}]},"ts":"1694674927020"} 2023-09-14 07:02:07,020 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1694674897568.dcece324dff3caa44d99f937827c7e71.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694674927020"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694674927020"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694674927020"}]},"ts":"1694674927020"} 2023-09-14 07:02:07,022 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 2f87abbb5bb7866490ffd5cc901aa69f, server=jenkins-hbase4.apache.org,37703,1694674856695}] 2023-09-14 07:02:07,023 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure dcece324dff3caa44d99f937827c7e71, server=jenkins-hbase4.apache.org,41005,1694674856735}] 2023-09-14 07:02:07,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-14 07:02:07,174 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2f87abbb5bb7866490ffd5cc901aa69f 2023-09-14 07:02:07,174 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2f87abbb5bb7866490ffd5cc901aa69f, disabling compactions & flushes 2023-09-14 07:02:07,174 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1694674897568.2f87abbb5bb7866490ffd5cc901aa69f. 2023-09-14 07:02:07,174 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1694674897568.2f87abbb5bb7866490ffd5cc901aa69f. 2023-09-14 07:02:07,174 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1694674897568.2f87abbb5bb7866490ffd5cc901aa69f. after waiting 0 ms 2023-09-14 07:02:07,174 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1694674897568.2f87abbb5bb7866490ffd5cc901aa69f. 2023-09-14 07:02:07,176 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close dcece324dff3caa44d99f937827c7e71 2023-09-14 07:02:07,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing dcece324dff3caa44d99f937827c7e71, disabling compactions & flushes 2023-09-14 07:02:07,179 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1694674897568.dcece324dff3caa44d99f937827c7e71. 2023-09-14 07:02:07,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1694674897568.dcece324dff3caa44d99f937827c7e71. 2023-09-14 07:02:07,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1694674897568.dcece324dff3caa44d99f937827c7e71. after waiting 0 ms 2023-09-14 07:02:07,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1694674897568.dcece324dff3caa44d99f937827c7e71. 2023-09-14 07:02:07,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testConsecutiveExports/2f87abbb5bb7866490ffd5cc901aa69f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-14 07:02:07,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testConsecutiveExports/dcece324dff3caa44d99f937827c7e71/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-14 07:02:07,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-14 07:02:07,189 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1694674897568.2f87abbb5bb7866490ffd5cc901aa69f. 2023-09-14 07:02:07,189 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2f87abbb5bb7866490ffd5cc901aa69f: 2023-09-14 07:02:07,190 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-14 07:02:07,191 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1694674897568.dcece324dff3caa44d99f937827c7e71. 2023-09-14 07:02:07,191 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for dcece324dff3caa44d99f937827c7e71: 2023-09-14 07:02:07,192 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2f87abbb5bb7866490ffd5cc901aa69f 2023-09-14 07:02:07,193 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=2f87abbb5bb7866490ffd5cc901aa69f, regionState=CLOSED 2023-09-14 07:02:07,193 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1694674897568.2f87abbb5bb7866490ffd5cc901aa69f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694674927193"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694674927193"}]},"ts":"1694674927193"} 2023-09-14 07:02:07,193 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed dcece324dff3caa44d99f937827c7e71 2023-09-14 07:02:07,194 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=dcece324dff3caa44d99f937827c7e71, regionState=CLOSED 2023-09-14 07:02:07,194 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1694674897568.dcece324dff3caa44d99f937827c7e71.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694674927193"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694674927193"}]},"ts":"1694674927193"} 2023-09-14 07:02:07,196 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=52 2023-09-14 07:02:07,196 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 2f87abbb5bb7866490ffd5cc901aa69f, server=jenkins-hbase4.apache.org,37703,1694674856695 in 172 msec 2023-09-14 07:02:07,197 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=53 2023-09-14 07:02:07,197 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure dcece324dff3caa44d99f937827c7e71, server=jenkins-hbase4.apache.org,41005,1694674856735 in 173 msec 2023-09-14 07:02:07,197 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=2f87abbb5bb7866490ffd5cc901aa69f, UNASSIGN in 179 msec 2023-09-14 07:02:07,198 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-09-14 07:02:07,199 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=dcece324dff3caa44d99f937827c7e71, UNASSIGN in 180 msec 2023-09-14 07:02:07,199 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694674927199"}]},"ts":"1694674927199"} 2023-09-14 07:02:07,200 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-09-14 07:02:07,202 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-09-14 07:02:07,204 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 193 msec 2023-09-14 07:02:07,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-14 07:02:07,315 INFO [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-09-14 07:02:07,316 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-09-14 07:02:07,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-14 07:02:07,319 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-14 07:02:07,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-09-14 07:02:07,320 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-14 07:02:07,323 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35941] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-09-14 07:02:07,326 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testConsecutiveExports/2f87abbb5bb7866490ffd5cc901aa69f 2023-09-14 07:02:07,326 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testConsecutiveExports/dcece324dff3caa44d99f937827c7e71 2023-09-14 07:02:07,326 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-14 07:02:07,326 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-14 07:02:07,326 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-14 07:02:07,327 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-14 07:02:07,327 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-14 07:02:07,327 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-14 07:02:07,327 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-14 07:02:07,327 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-14 07:02:07,328 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-14 07:02:07,328 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-14 07:02:07,328 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 07:02:07,328 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testConsecutiveExports/2f87abbb5bb7866490ffd5cc901aa69f/cf, FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testConsecutiveExports/2f87abbb5bb7866490ffd5cc901aa69f/recovered.edits] 2023-09-14 07:02:07,328 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-14 07:02:07,329 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testConsecutiveExports/dcece324dff3caa44d99f937827c7e71/cf, FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testConsecutiveExports/dcece324dff3caa44d99f937827c7e71/recovered.edits] 2023-09-14 07:02:07,329 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 07:02:07,328 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 07:02:07,328 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-14 07:02:07,329 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 07:02:07,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-14 07:02:07,334 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testConsecutiveExports/2f87abbb5bb7866490ffd5cc901aa69f/cf/2221f175a1c04190ad6667a100aad159 to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/archive/data/default/testtb-testConsecutiveExports/2f87abbb5bb7866490ffd5cc901aa69f/cf/2221f175a1c04190ad6667a100aad159 2023-09-14 07:02:07,335 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testConsecutiveExports/dcece324dff3caa44d99f937827c7e71/cf/ccd9aaf5ff7f4a4593c1a4390ca4dcc1 to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/archive/data/default/testtb-testConsecutiveExports/dcece324dff3caa44d99f937827c7e71/cf/ccd9aaf5ff7f4a4593c1a4390ca4dcc1 2023-09-14 07:02:07,338 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testConsecutiveExports/2f87abbb5bb7866490ffd5cc901aa69f/recovered.edits/9.seqid to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/archive/data/default/testtb-testConsecutiveExports/2f87abbb5bb7866490ffd5cc901aa69f/recovered.edits/9.seqid 2023-09-14 07:02:07,339 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testConsecutiveExports/dcece324dff3caa44d99f937827c7e71/recovered.edits/9.seqid to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/archive/data/default/testtb-testConsecutiveExports/dcece324dff3caa44d99f937827c7e71/recovered.edits/9.seqid 2023-09-14 07:02:07,339 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testConsecutiveExports/2f87abbb5bb7866490ffd5cc901aa69f 2023-09-14 07:02:07,339 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testConsecutiveExports/dcece324dff3caa44d99f937827c7e71 2023-09-14 07:02:07,339 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-14 07:02:07,340 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-14 07:02:07,340 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-09-14 07:02:07,344 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202309149ed7c63a59164278b59a7ab960a99b63 to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202309149ed7c63a59164278b59a7ab960a99b63 2023-09-14 07:02:07,345 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230914cb7d9f4fc6734e0aa8e41c3d2347cd02 to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230914cb7d9f4fc6734e0aa8e41c3d2347cd02 2023-09-14 07:02:07,345 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-14 07:02:07,348 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-14 07:02:07,350 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-09-14 07:02:07,352 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-09-14 07:02:07,353 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-14 07:02:07,353 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-09-14 07:02:07,353 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1694674897568.2f87abbb5bb7866490ffd5cc901aa69f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694674927353"}]},"ts":"9223372036854775807"} 2023-09-14 07:02:07,353 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1694674897568.dcece324dff3caa44d99f937827c7e71.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694674927353"}]},"ts":"9223372036854775807"} 2023-09-14 07:02:07,355 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-14 07:02:07,355 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 2f87abbb5bb7866490ffd5cc901aa69f, NAME => 'testtb-testConsecutiveExports,,1694674897568.2f87abbb5bb7866490ffd5cc901aa69f.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => dcece324dff3caa44d99f937827c7e71, NAME => 'testtb-testConsecutiveExports,1,1694674897568.dcece324dff3caa44d99f937827c7e71.', STARTKEY => '1', ENDKEY => ''}] 2023-09-14 07:02:07,355 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-09-14 07:02:07,355 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694674927355"}]},"ts":"9223372036854775807"} 2023-09-14 07:02:07,356 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-09-14 07:02:07,358 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-14 07:02:07,360 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 42 msec 2023-09-14 07:02:07,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-14 07:02:07,431 INFO [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-09-14 07:02:07,440 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-09-14 07:02:07,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-09-14 07:02:07,443 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-09-14 07:02:07,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-09-14 07:02:07,468 INFO [Listener at jenkins-hbase4.apache.org/40843] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=753 (was 767), OpenFileDescriptor=909 (was 927), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=202 (was 211), ProcessCount=168 (was 167) - ProcessCount LEAK? -, AvailableMemoryMB=8424 (was 8580) 2023-09-14 07:02:07,468 WARN [Listener at jenkins-hbase4.apache.org/40843] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-09-14 07:02:07,487 INFO [Listener at jenkins-hbase4.apache.org/40843] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=753, OpenFileDescriptor=909, MaxFileDescriptor=60000, SystemLoadAverage=202, ProcessCount=168, AvailableMemoryMB=8423 2023-09-14 07:02:07,487 WARN [Listener at jenkins-hbase4.apache.org/40843] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-09-14 07:02:07,489 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-14 07:02:07,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:07,492 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-09-14 07:02:07,493 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-09-14 07:02:07,493 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-14 07:02:07,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-14 07:02:07,496 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5af0873ae06df6e9d1832003ba7e51f6 2023-09-14 07:02:07,496 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/4e4922dd21c5b19c92845fc3c574d451 2023-09-14 07:02:07,496 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5af0873ae06df6e9d1832003ba7e51f6 empty. 2023-09-14 07:02:07,496 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/4e4922dd21c5b19c92845fc3c574d451 empty. 2023-09-14 07:02:07,497 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5af0873ae06df6e9d1832003ba7e51f6 2023-09-14 07:02:07,497 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/4e4922dd21c5b19c92845fc3c574d451 2023-09-14 07:02:07,497 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-14 07:02:07,507 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-09-14 07:02:07,508 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5af0873ae06df6e9d1832003ba7e51f6, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1694674927489.5af0873ae06df6e9d1832003ba7e51f6.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp 2023-09-14 07:02:07,508 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 4e4922dd21c5b19c92845fc3c574d451, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1694674927489.4e4922dd21c5b19c92845fc3c574d451.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp 2023-09-14 07:02:07,521 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1694674927489.5af0873ae06df6e9d1832003ba7e51f6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 07:02:07,521 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 5af0873ae06df6e9d1832003ba7e51f6, disabling compactions & flushes 2023-09-14 07:02:07,521 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1694674927489.5af0873ae06df6e9d1832003ba7e51f6. 2023-09-14 07:02:07,521 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1694674927489.5af0873ae06df6e9d1832003ba7e51f6. 2023-09-14 07:02:07,521 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1694674927489.5af0873ae06df6e9d1832003ba7e51f6. after waiting 0 ms 2023-09-14 07:02:07,521 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1694674927489.5af0873ae06df6e9d1832003ba7e51f6. 2023-09-14 07:02:07,521 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1694674927489.5af0873ae06df6e9d1832003ba7e51f6. 2023-09-14 07:02:07,521 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 5af0873ae06df6e9d1832003ba7e51f6: 2023-09-14 07:02:07,521 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1694674927489.4e4922dd21c5b19c92845fc3c574d451.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 07:02:07,521 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 4e4922dd21c5b19c92845fc3c574d451, disabling compactions & flushes 2023-09-14 07:02:07,521 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1694674927489.4e4922dd21c5b19c92845fc3c574d451. 2023-09-14 07:02:07,521 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1694674927489.4e4922dd21c5b19c92845fc3c574d451. 2023-09-14 07:02:07,521 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1694674927489.4e4922dd21c5b19c92845fc3c574d451. after waiting 0 ms 2023-09-14 07:02:07,521 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1694674927489.4e4922dd21c5b19c92845fc3c574d451. 2023-09-14 07:02:07,522 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1694674927489.4e4922dd21c5b19c92845fc3c574d451. 2023-09-14 07:02:07,522 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 4e4922dd21c5b19c92845fc3c574d451: 2023-09-14 07:02:07,524 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-09-14 07:02:07,525 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694674927489.5af0873ae06df6e9d1832003ba7e51f6.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694674927524"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694674927524"}]},"ts":"1694674927524"} 2023-09-14 07:02:07,525 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694674927489.4e4922dd21c5b19c92845fc3c574d451.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694674927524"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694674927524"}]},"ts":"1694674927524"} 2023-09-14 07:02:07,532 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-14 07:02:07,533 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-14 07:02:07,533 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694674927533"}]},"ts":"1694674927533"} 2023-09-14 07:02:07,534 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-09-14 07:02:07,538 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-14 07:02:07,539 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-14 07:02:07,539 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-14 07:02:07,539 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-14 07:02:07,539 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-14 07:02:07,539 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=5af0873ae06df6e9d1832003ba7e51f6, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=4e4922dd21c5b19c92845fc3c574d451, ASSIGN}] 2023-09-14 07:02:07,541 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=4e4922dd21c5b19c92845fc3c574d451, ASSIGN 2023-09-14 07:02:07,541 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=5af0873ae06df6e9d1832003ba7e51f6, ASSIGN 2023-09-14 07:02:07,542 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=4e4922dd21c5b19c92845fc3c574d451, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37703,1694674856695; forceNewPlan=false, retain=false 2023-09-14 07:02:07,542 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=5af0873ae06df6e9d1832003ba7e51f6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35941,1694674856649; forceNewPlan=false, retain=false 2023-09-14 07:02:07,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-14 07:02:07,692 INFO [jenkins-hbase4:33055] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-14 07:02:07,695 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=4e4922dd21c5b19c92845fc3c574d451, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:07,695 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=5af0873ae06df6e9d1832003ba7e51f6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:07,695 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694674927489.4e4922dd21c5b19c92845fc3c574d451.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694674927695"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694674927695"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694674927695"}]},"ts":"1694674927695"} 2023-09-14 07:02:07,695 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694674927489.5af0873ae06df6e9d1832003ba7e51f6.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694674927695"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694674927695"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694674927695"}]},"ts":"1694674927695"} 2023-09-14 07:02:07,697 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 4e4922dd21c5b19c92845fc3c574d451, server=jenkins-hbase4.apache.org,37703,1694674856695}] 2023-09-14 07:02:07,698 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 5af0873ae06df6e9d1832003ba7e51f6, server=jenkins-hbase4.apache.org,35941,1694674856649}] 2023-09-14 07:02:07,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-14 07:02:07,858 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1694674927489.4e4922dd21c5b19c92845fc3c574d451. 2023-09-14 07:02:07,858 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1694674927489.5af0873ae06df6e9d1832003ba7e51f6. 2023-09-14 07:02:07,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4e4922dd21c5b19c92845fc3c574d451, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1694674927489.4e4922dd21c5b19c92845fc3c574d451.', STARTKEY => '1', ENDKEY => ''} 2023-09-14 07:02:07,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5af0873ae06df6e9d1832003ba7e51f6, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1694674927489.5af0873ae06df6e9d1832003ba7e51f6.', STARTKEY => '', ENDKEY => '1'} 2023-09-14 07:02:07,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1694674927489.4e4922dd21c5b19c92845fc3c574d451. service=AccessControlService 2023-09-14 07:02:07,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1694674927489.5af0873ae06df6e9d1832003ba7e51f6. service=AccessControlService 2023-09-14 07:02:07,859 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-14 07:02:07,859 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-14 07:02:07,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 4e4922dd21c5b19c92845fc3c574d451 2023-09-14 07:02:07,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 5af0873ae06df6e9d1832003ba7e51f6 2023-09-14 07:02:07,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1694674927489.4e4922dd21c5b19c92845fc3c574d451.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 07:02:07,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1694674927489.5af0873ae06df6e9d1832003ba7e51f6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 07:02:07,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4e4922dd21c5b19c92845fc3c574d451 2023-09-14 07:02:07,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5af0873ae06df6e9d1832003ba7e51f6 2023-09-14 07:02:07,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4e4922dd21c5b19c92845fc3c574d451 2023-09-14 07:02:07,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5af0873ae06df6e9d1832003ba7e51f6 2023-09-14 07:02:07,860 INFO [StoreOpener-5af0873ae06df6e9d1832003ba7e51f6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5af0873ae06df6e9d1832003ba7e51f6 2023-09-14 07:02:07,860 INFO [StoreOpener-4e4922dd21c5b19c92845fc3c574d451-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4e4922dd21c5b19c92845fc3c574d451 2023-09-14 07:02:07,862 DEBUG [StoreOpener-5af0873ae06df6e9d1832003ba7e51f6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion/5af0873ae06df6e9d1832003ba7e51f6/cf 2023-09-14 07:02:07,862 DEBUG [StoreOpener-4e4922dd21c5b19c92845fc3c574d451-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion/4e4922dd21c5b19c92845fc3c574d451/cf 2023-09-14 07:02:07,862 DEBUG [StoreOpener-4e4922dd21c5b19c92845fc3c574d451-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion/4e4922dd21c5b19c92845fc3c574d451/cf 2023-09-14 07:02:07,862 DEBUG [StoreOpener-5af0873ae06df6e9d1832003ba7e51f6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion/5af0873ae06df6e9d1832003ba7e51f6/cf 2023-09-14 07:02:07,863 INFO [StoreOpener-5af0873ae06df6e9d1832003ba7e51f6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5af0873ae06df6e9d1832003ba7e51f6 columnFamilyName cf 2023-09-14 07:02:07,863 INFO [StoreOpener-4e4922dd21c5b19c92845fc3c574d451-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4e4922dd21c5b19c92845fc3c574d451 columnFamilyName cf 2023-09-14 07:02:07,865 INFO [StoreOpener-4e4922dd21c5b19c92845fc3c574d451-1] regionserver.HStore(310): Store=4e4922dd21c5b19c92845fc3c574d451/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-14 07:02:07,865 INFO [StoreOpener-5af0873ae06df6e9d1832003ba7e51f6-1] regionserver.HStore(310): Store=5af0873ae06df6e9d1832003ba7e51f6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-14 07:02:07,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion/4e4922dd21c5b19c92845fc3c574d451 2023-09-14 07:02:07,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion/5af0873ae06df6e9d1832003ba7e51f6 2023-09-14 07:02:07,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion/4e4922dd21c5b19c92845fc3c574d451 2023-09-14 07:02:07,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion/5af0873ae06df6e9d1832003ba7e51f6 2023-09-14 07:02:07,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4e4922dd21c5b19c92845fc3c574d451 2023-09-14 07:02:07,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5af0873ae06df6e9d1832003ba7e51f6 2023-09-14 07:02:07,871 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion/4e4922dd21c5b19c92845fc3c574d451/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-14 07:02:07,871 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion/5af0873ae06df6e9d1832003ba7e51f6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-14 07:02:07,872 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4e4922dd21c5b19c92845fc3c574d451; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60411109, jitterRate=-0.09980432689189911}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-14 07:02:07,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4e4922dd21c5b19c92845fc3c574d451: 2023-09-14 07:02:07,872 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5af0873ae06df6e9d1832003ba7e51f6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61504095, jitterRate=-0.08351756632328033}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-14 07:02:07,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5af0873ae06df6e9d1832003ba7e51f6: 2023-09-14 07:02:07,873 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1694674927489.4e4922dd21c5b19c92845fc3c574d451., pid=60, masterSystemTime=1694674927849 2023-09-14 07:02:07,873 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1694674927489.5af0873ae06df6e9d1832003ba7e51f6., pid=61, masterSystemTime=1694674927849 2023-09-14 07:02:07,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1694674927489.4e4922dd21c5b19c92845fc3c574d451. 2023-09-14 07:02:07,875 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1694674927489.4e4922dd21c5b19c92845fc3c574d451. 2023-09-14 07:02:07,875 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=4e4922dd21c5b19c92845fc3c574d451, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:07,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1694674927489.5af0873ae06df6e9d1832003ba7e51f6. 2023-09-14 07:02:07,876 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694674927489.4e4922dd21c5b19c92845fc3c574d451.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694674927875"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694674927875"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694674927875"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694674927875"}]},"ts":"1694674927875"} 2023-09-14 07:02:07,876 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1694674927489.5af0873ae06df6e9d1832003ba7e51f6. 2023-09-14 07:02:07,876 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=5af0873ae06df6e9d1832003ba7e51f6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:07,876 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694674927489.5af0873ae06df6e9d1832003ba7e51f6.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694674927876"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694674927876"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694674927876"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694674927876"}]},"ts":"1694674927876"} 2023-09-14 07:02:07,880 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-09-14 07:02:07,880 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 4e4922dd21c5b19c92845fc3c574d451, server=jenkins-hbase4.apache.org,37703,1694674856695 in 181 msec 2023-09-14 07:02:07,881 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=58 2023-09-14 07:02:07,881 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 5af0873ae06df6e9d1832003ba7e51f6, server=jenkins-hbase4.apache.org,35941,1694674856649 in 181 msec 2023-09-14 07:02:07,881 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=4e4922dd21c5b19c92845fc3c574d451, ASSIGN in 341 msec 2023-09-14 07:02:07,882 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=58, resume processing ppid=57 2023-09-14 07:02:07,882 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=5af0873ae06df6e9d1832003ba7e51f6, ASSIGN in 342 msec 2023-09-14 07:02:07,883 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-14 07:02:07,883 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694674927883"}]},"ts":"1694674927883"} 2023-09-14 07:02:07,885 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-09-14 07:02:07,887 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-09-14 07:02:07,887 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-09-14 07:02:07,889 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35941] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-14 07:02:07,890 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 07:02:07,890 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 07:02:07,890 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 07:02:07,890 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 07:02:07,892 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-14 07:02:07,892 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-14 07:02:07,892 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-14 07:02:07,892 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-14 07:02:07,893 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 403 msec 2023-09-14 07:02:08,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-14 07:02:08,097 INFO [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-09-14 07:02:08,100 DEBUG [Listener at jenkins-hbase4.apache.org/40843] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,100 DEBUG [Listener at jenkins-hbase4.apache.org/40843] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1694674927489.5af0873ae06df6e9d1832003ba7e51f6. 2023-09-14 07:02:08,102 INFO [Listener at jenkins-hbase4.apache.org/40843] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-14 07:02:08,114 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-14 07:02:08,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694674928114 (current time:1694674928114). 2023-09-14 07:02:08,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-14 07:02:08,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] zookeeper.ReadOnlyZKClient(139): Connect 0x230a3e24 to 127.0.0.1:52295 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 07:02:08,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5a042c32, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 07:02:08,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 07:02:08,126 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47490, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 07:02:08,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x230a3e24 to 127.0.0.1:52295 2023-09-14 07:02:08,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 07:02:08,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] zookeeper.ReadOnlyZKClient(139): Connect 0x7b1f164a to 127.0.0.1:52295 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 07:02:08,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@916ec13, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 07:02:08,135 DEBUG [hconnection-0x720834bf-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 07:02:08,136 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47504, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 07:02:08,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 07:02:08,142 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41380, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 07:02:08,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7b1f164a to 127.0.0.1:52295 2023-09-14 07:02:08,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 07:02:08,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-14 07:02:08,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-14 07:02:08,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-14 07:02:08,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-14 07:02:08,146 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-14 07:02:08,147 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1694675528147 2023-09-14 07:02:08,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-14 07:02:08,147 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,148 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-14 07:02:08,149 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-14 07:02:08,149 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-14 07:02:08,150 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-14 07:02:08,150 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-09-14 07:02:08,151 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-14 07:02:08,152 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1694675528152 2023-09-14 07:02:08,160 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,160 INFO [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-14 07:02:08,160 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 07:02:08,161 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-14 07:02:08,162 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-14 07:02:08,162 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,162 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,164 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:02:08,164 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:02:08,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:02:08,164 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:08,164 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:02:08,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:02:08,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:02:08,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:02:08,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:02:08,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:02:08,165 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:08,165 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:08,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,165 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:08,165 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-14 07:02:08,165 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,165 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,165 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-14 07:02:08,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-14 07:02:08,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-14 07:02:08,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,166 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-14 07:02:08,166 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-14 07:02:08,166 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-14 07:02:08,166 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,166 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,166 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-14 07:02:08,166 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,166 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 07:02:08,166 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-14 07:02:08,166 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 07:02:08,167 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-14 07:02:08,168 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-14 07:02:08,166 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-14 07:02:08,168 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 07:02:08,168 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41005,1694674856735' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-14 07:02:08,169 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-14 07:02:08,169 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-14 07:02:08,169 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37703,1694674856695' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-14 07:02:08,168 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-14 07:02:08,169 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-14 07:02:08,169 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35941,1694674856649' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-14 07:02:08,171 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,171 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,171 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:08,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:08,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:02:08,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:02:08,171 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:08,171 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:02:08,171 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,172 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 07:02:08,171 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,172 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 07:02:08,172 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,172 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 07:02:08,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:02:08,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:08,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:08,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:08,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:02:08,173 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37703,1694674856695' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-14 07:02:08,173 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7c210990[Count = 1] remaining members to acquire global barrier 2023-09-14 07:02:08,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:08,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:02:08,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:02:08,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:02:08,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:02:08,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:08,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:08,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:08,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:02:08,175 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35941,1694674856649' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-14 07:02:08,175 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7c210990[Count = 0] remaining members to acquire global barrier 2023-09-14 07:02:08,175 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-14 07:02:08,175 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,176 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,176 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,176 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,177 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-14 07:02:08,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,176 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:08,177 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-14 07:02:08,177 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-14 07:02:08,177 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-14 07:02:08,177 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-14 07:02:08,177 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-14 07:02:08,177 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1694674927489.4e4922dd21c5b19c92845fc3c574d451. 2023-09-14 07:02:08,177 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:08,177 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1694674927489.4e4922dd21c5b19c92845fc3c574d451. started... 2023-09-14 07:02:08,177 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-14 07:02:08,177 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-14 07:02:08,177 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1694674927489.5af0873ae06df6e9d1832003ba7e51f6. 2023-09-14 07:02:08,178 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4e4922dd21c5b19c92845fc3c574d451: 2023-09-14 07:02:08,178 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1694674927489.5af0873ae06df6e9d1832003ba7e51f6. started... 2023-09-14 07:02:08,177 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,41005,1694674856735' in zk 2023-09-14 07:02:08,177 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-14 07:02:08,178 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1694674927489.4e4922dd21c5b19c92845fc3c574d451.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,179 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5af0873ae06df6e9d1832003ba7e51f6: 2023-09-14 07:02:08,179 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-14 07:02:08,179 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-14 07:02:08,179 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1694674927489.5af0873ae06df6e9d1832003ba7e51f6.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,179 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-14 07:02:08,179 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-14 07:02:08,186 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-14 07:02:08,186 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 07:02:08,186 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-14 07:02:08,190 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1694674927489.5af0873ae06df6e9d1832003ba7e51f6. completed. 2023-09-14 07:02:08,191 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1694674927489.4e4922dd21c5b19c92845fc3c574d451. completed. 2023-09-14 07:02:08,191 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1694674927489.4e4922dd21c5b19c92845fc3c574d451. 2023-09-14 07:02:08,191 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1694674927489.5af0873ae06df6e9d1832003ba7e51f6. 2023-09-14 07:02:08,191 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-14 07:02:08,191 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-14 07:02:08,191 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-14 07:02:08,191 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:08,191 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-14 07:02:08,191 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-14 07:02:08,191 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:08,191 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35941,1694674856649' in zk 2023-09-14 07:02:08,191 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-14 07:02:08,191 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37703,1694674856695' in zk 2023-09-14 07:02:08,192 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-14 07:02:08,193 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:08,192 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-14 07:02:08,193 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:08,193 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 07:02:08,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:08,193 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 07:02:08,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:02:08,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:02:08,193 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-14 07:02:08,194 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-14 07:02:08,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:02:08,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:02:08,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:08,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:08,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:08,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:02:08,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:08,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:08,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:08,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,37703,1694674856695': 2023-09-14 07:02:08,199 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37703,1694674856695' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-14 07:02:08,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:08,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:02:08,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:02:08,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:02:08,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:02:08,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:08,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:08,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:08,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:02:08,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:08,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:08,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:08,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,35941,1694674856649': 2023-09-14 07:02:08,203 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35941,1694674856649' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-14 07:02:08,203 INFO [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-14 07:02:08,203 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-14 07:02:08,203 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-14 07:02:08,203 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,203 INFO [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-14 07:02:08,205 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,205 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,205 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,205 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:02:08,205 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:02:08,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:02:08,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,206 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:08,205 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:02:08,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,206 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:02:08,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:02:08,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:02:08,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:02:08,206 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:08,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:02:08,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:02:08,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:02:08,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:02:08,207 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:08,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:02:08,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:08,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:08,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:08,209 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:08,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:02:08,210 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:08,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,210 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:08,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:08,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:08,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:08,213 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:08,213 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,213 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:02:08,213 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:08,213 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:02:08,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:02:08,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:02:08,213 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:02:08,213 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:08,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:02:08,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:02:08,213 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,213 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:02:08,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:02:08,213 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:02:08,213 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,213 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 07:02:08,214 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:02:08,214 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,213 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:02:08,214 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-14 07:02:08,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:02:08,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:02:08,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:02:08,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:02:08,216 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-14 07:02:08,214 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:08,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:02:08,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:02:08,218 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,218 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:08,218 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:08,218 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,218 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,226 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,227 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,245 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,246 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-14 07:02:08,246 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,246 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,246 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1694674928147Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1694674928226 (+79 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1694674928226Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1694674928226Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1694674928232 (+6 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1694674928239 (+7 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1694674928246 (+7 ms) 2023-09-14 07:02:08,249 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-14 07:02:08,249 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-14 07:02:08,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-14 07:02:08,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-14 07:02:08,251 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 101 msec 2023-09-14 07:02:08,252 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35941] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1694674927489.5af0873ae06df6e9d1832003ba7e51f6. with WAL disabled. Data may be lost in the event of a crash. 2023-09-14 07:02:08,254 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37703] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1694674927489.4e4922dd21c5b19c92845fc3c574d451. with WAL disabled. Data may be lost in the event of a crash. 2023-09-14 07:02:08,257 DEBUG [Listener at jenkins-hbase4.apache.org/40843] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,257 DEBUG [Listener at jenkins-hbase4.apache.org/40843] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1694674927489.5af0873ae06df6e9d1832003ba7e51f6. 2023-09-14 07:02:08,257 INFO [Listener at jenkins-hbase4.apache.org/40843] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-14 07:02:08,267 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-14 07:02:08,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694674928267 (current time:1694674928267). 2023-09-14 07:02:08,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-14 07:02:08,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] zookeeper.ReadOnlyZKClient(139): Connect 0x364fae65 to 127.0.0.1:52295 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 07:02:08,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@37cc1cb8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 07:02:08,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 07:02:08,278 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47514, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 07:02:08,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x364fae65 to 127.0.0.1:52295 2023-09-14 07:02:08,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 07:02:08,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] zookeeper.ReadOnlyZKClient(139): Connect 0x49d2c73e to 127.0.0.1:52295 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 07:02:08,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22564e7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 07:02:08,286 DEBUG [hconnection-0x555b91c7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 07:02:08,288 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47530, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 07:02:08,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 07:02:08,294 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41386, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 07:02:08,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x49d2c73e to 127.0.0.1:52295 2023-09-14 07:02:08,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 07:02:08,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-14 07:02:08,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-14 07:02:08,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-14 07:02:08,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-14 07:02:08,298 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-14 07:02:08,299 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1694675528299 2023-09-14 07:02:08,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-14 07:02:08,299 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,300 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-14 07:02:08,301 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-14 07:02:08,301 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-14 07:02:08,302 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-14 07:02:08,302 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 4 msec 2023-09-14 07:02:08,303 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-14 07:02:08,304 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1694675528304 2023-09-14 07:02:08,312 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,312 INFO [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-14 07:02:08,312 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 07:02:08,313 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-14 07:02:08,313 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-14 07:02:08,314 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,314 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,316 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:02:08,316 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:02:08,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:02:08,316 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:08,316 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:02:08,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:02:08,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:02:08,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:02:08,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:02:08,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:02:08,317 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:08,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,317 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:08,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,317 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,317 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:08,317 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-14 07:02:08,317 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-14 07:02:08,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,318 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-14 07:02:08,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-14 07:02:08,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,318 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-14 07:02:08,318 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,318 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-14 07:02:08,318 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,318 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 07:02:08,318 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-14 07:02:08,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,319 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 07:02:08,319 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-14 07:02:08,320 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-14 07:02:08,320 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-14 07:02:08,320 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-14 07:02:08,320 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37703,1694674856695' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-14 07:02:08,320 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41005,1694674856735' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-14 07:02:08,321 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-14 07:02:08,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,321 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-14 07:02:08,321 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,321 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-14 07:02:08,321 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 07:02:08,322 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-14 07:02:08,322 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-14 07:02:08,322 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35941,1694674856649' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-14 07:02:08,322 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,322 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,322 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:08,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:08,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:02:08,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:02:08,323 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,323 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 07:02:08,323 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,323 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 07:02:08,324 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:08,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:02:08,324 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:02:08,324 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,324 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 07:02:08,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:08,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:08,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:08,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:02:08,326 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37703,1694674856695' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-14 07:02:08,326 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@65fb61a9[Count = 1] remaining members to acquire global barrier 2023-09-14 07:02:08,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:08,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:02:08,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:02:08,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:02:08,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:02:08,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:08,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:08,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:08,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:02:08,328 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35941,1694674856649' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-14 07:02:08,328 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@65fb61a9[Count = 0] remaining members to acquire global barrier 2023-09-14 07:02:08,328 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-14 07:02:08,328 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,329 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,329 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,329 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,330 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-14 07:02:08,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,330 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:08,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,330 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-14 07:02:08,330 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1694674927489.4e4922dd21c5b19c92845fc3c574d451. 2023-09-14 07:02:08,330 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-14 07:02:08,330 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1694674927489.4e4922dd21c5b19c92845fc3c574d451. started... 2023-09-14 07:02:08,330 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-14 07:02:08,330 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:08,330 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-14 07:02:08,330 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-14 07:02:08,330 INFO [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4e4922dd21c5b19c92845fc3c574d451 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-09-14 07:02:08,330 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-14 07:02:08,330 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1694674927489.5af0873ae06df6e9d1832003ba7e51f6. 2023-09-14 07:02:08,330 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-14 07:02:08,331 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1694674927489.5af0873ae06df6e9d1832003ba7e51f6. started... 2023-09-14 07:02:08,330 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,41005,1694674856735' in zk 2023-09-14 07:02:08,331 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-14 07:02:08,331 INFO [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5af0873ae06df6e9d1832003ba7e51f6 1/1 column families, dataSize=333 B heapSize=976 B 2023-09-14 07:02:08,333 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-14 07:02:08,333 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 07:02:08,333 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-14 07:02:08,354 INFO [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309142b324e443c3e4d8f9878c71799fed03b to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202309142b324e443c3e4d8f9878c71799fed03b 2023-09-14 07:02:08,355 INFO [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230914b1156a179e5440a5a117ffd221c78240 to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230914b1156a179e5440a5a117ffd221c78240 2023-09-14 07:02:08,365 INFO [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion/5af0873ae06df6e9d1832003ba7e51f6/.tmp/cf/4f575e4654834c91a67e6c19b08eebef 2023-09-14 07:02:08,365 INFO [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion/4e4922dd21c5b19c92845fc3c574d451/.tmp/cf/70e176724ecb419bb41c61bcecd636f9 2023-09-14 07:02:08,371 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion/5af0873ae06df6e9d1832003ba7e51f6/.tmp/cf/4f575e4654834c91a67e6c19b08eebef as hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion/5af0873ae06df6e9d1832003ba7e51f6/cf/4f575e4654834c91a67e6c19b08eebef 2023-09-14 07:02:08,371 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion/4e4922dd21c5b19c92845fc3c574d451/.tmp/cf/70e176724ecb419bb41c61bcecd636f9 as hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion/4e4922dd21c5b19c92845fc3c574d451/cf/70e176724ecb419bb41c61bcecd636f9 2023-09-14 07:02:08,375 INFO [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion/5af0873ae06df6e9d1832003ba7e51f6/cf/4f575e4654834c91a67e6c19b08eebef, entries=5, sequenceid=6, filesize=5.8 K 2023-09-14 07:02:08,375 INFO [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion/4e4922dd21c5b19c92845fc3c574d451/cf/70e176724ecb419bb41c61bcecd636f9, entries=45, sequenceid=6, filesize=13.2 K 2023-09-14 07:02:08,376 INFO [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 5af0873ae06df6e9d1832003ba7e51f6 in 45ms, sequenceid=6, compaction requested=false 2023-09-14 07:02:08,376 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-14 07:02:08,376 INFO [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 4e4922dd21c5b19c92845fc3c574d451 in 46ms, sequenceid=6, compaction requested=false 2023-09-14 07:02:08,376 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-14 07:02:08,379 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5af0873ae06df6e9d1832003ba7e51f6: 2023-09-14 07:02:08,379 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4e4922dd21c5b19c92845fc3c574d451: 2023-09-14 07:02:08,380 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1694674927489.5af0873ae06df6e9d1832003ba7e51f6.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,380 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1694674927489.4e4922dd21c5b19c92845fc3c574d451.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,380 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-14 07:02:08,380 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-14 07:02:08,380 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion/5af0873ae06df6e9d1832003ba7e51f6/cf/4f575e4654834c91a67e6c19b08eebef] hfiles 2023-09-14 07:02:08,380 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion/4e4922dd21c5b19c92845fc3c574d451/cf/70e176724ecb419bb41c61bcecd636f9] hfiles 2023-09-14 07:02:08,380 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion/5af0873ae06df6e9d1832003ba7e51f6/cf/4f575e4654834c91a67e6c19b08eebef for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,380 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion/4e4922dd21c5b19c92845fc3c574d451/cf/70e176724ecb419bb41c61bcecd636f9 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,387 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1694674927489.5af0873ae06df6e9d1832003ba7e51f6. completed. 2023-09-14 07:02:08,387 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1694674927489.5af0873ae06df6e9d1832003ba7e51f6. 2023-09-14 07:02:08,387 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-14 07:02:08,387 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-14 07:02:08,387 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:08,387 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-14 07:02:08,387 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35941,1694674856649' in zk 2023-09-14 07:02:08,388 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1694674927489.4e4922dd21c5b19c92845fc3c574d451. completed. 2023-09-14 07:02:08,388 DEBUG [rs(jenkins-hbase4.apache.org,37703,1694674856695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1694674927489.4e4922dd21c5b19c92845fc3c574d451. 2023-09-14 07:02:08,388 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-14 07:02:08,388 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-14 07:02:08,388 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:08,388 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-14 07:02:08,388 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37703,1694674856695' in zk 2023-09-14 07:02:08,389 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-14 07:02:08,389 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:08,389 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 07:02:08,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:08,389 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-14 07:02:08,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:02:08,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:02:08,391 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-14 07:02:08,391 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:08,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:02:08,391 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 07:02:08,392 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-14 07:02:08,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:02:08,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:08,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:08,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:08,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:02:08,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:08,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:08,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:08,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,35941,1694674856649': 2023-09-14 07:02:08,395 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35941,1694674856649' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-14 07:02:08,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:08,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:02:08,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:02:08,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:02:08,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:02:08,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:08,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:08,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:08,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:02:08,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:08,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:08,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:08,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,37703,1694674856695': 2023-09-14 07:02:08,398 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37703,1694674856695' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-14 07:02:08,398 INFO [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-14 07:02:08,398 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-14 07:02:08,398 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-14 07:02:08,398 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,398 INFO [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-14 07:02:08,401 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-14 07:02:08,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-14 07:02:08,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-14 07:02:08,402 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-14 07:02:08,403 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,403 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:02:08,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,404 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:02:08,404 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,403 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,404 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:02:08,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:02:08,404 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:08,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,404 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:02:08,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:02:08,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:02:08,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:02:08,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:02:08,404 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:08,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:02:08,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:02:08,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:02:08,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:02:08,405 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:08,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:08,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:08,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:08,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:02:08,407 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:08,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,407 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:08,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:08,407 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:08,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:08,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:08,410 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:02:08,410 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:02:08,410 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:02:08,410 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:08,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:02:08,410 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:02:08,410 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,410 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 07:02:08,410 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,410 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-14 07:02:08,410 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,410 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:02:08,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:02:08,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:02:08,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:02:08,410 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:02:08,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:02:08,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:02:08,410 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:02:08,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:02:08,412 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:08,412 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:08,412 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,412 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:08,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:02:08,413 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:02:08,413 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:08,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:02:08,413 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202309142b324e443c3e4d8f9878c71799fed03b, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230914b1156a179e5440a5a117ffd221c78240] mob files 2023-09-14 07:02:08,413 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:08,413 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202309142b324e443c3e4d8f9878c71799fed03b 2023-09-14 07:02:08,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:02:08,413 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230914b1156a179e5440a5a117ffd221c78240 2023-09-14 07:02:08,413 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,413 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,420 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,420 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,438 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,439 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-14 07:02:08,439 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,439 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:08,440 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1694674928299Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1694674928420 (+121 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1694674928420Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1694674928420Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1694674928423 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1694674928430 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1694674928439 (+9 ms) 2023-09-14 07:02:08,442 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-14 07:02:08,444 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 142 msec 2023-09-14 07:02:08,602 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-14 07:02:08,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-14 07:02:08,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-14 07:02:08,632 DEBUG [Listener at jenkins-hbase4.apache.org/40843] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-14 07:02:08,636 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41402, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-14 07:02:08,637 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35941] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-14 07:02:08,638 DEBUG [Listener at jenkins-hbase4.apache.org/40843] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-14 07:02:08,640 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47538, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-14 07:02:08,640 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37703] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-14 07:02:08,641 DEBUG [Listener at jenkins-hbase4.apache.org/40843] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-14 07:02:08,646 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41774, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-14 07:02:08,647 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41005] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-14 07:02:08,649 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-14 07:02:08,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:08,652 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-09-14 07:02:08,652 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-09-14 07:02:08,652 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-14 07:02:08,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-14 07:02:08,655 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e9a36275e8fecd9f9c834fc560292b8 2023-09-14 07:02:08,655 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3c2cf412c9fb3441ecc99857ce7bd6b 2023-09-14 07:02:08,656 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e9a36275e8fecd9f9c834fc560292b8 empty. 2023-09-14 07:02:08,656 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3c2cf412c9fb3441ecc99857ce7bd6b empty. 2023-09-14 07:02:08,656 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e9a36275e8fecd9f9c834fc560292b8 2023-09-14 07:02:08,656 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3c2cf412c9fb3441ecc99857ce7bd6b 2023-09-14 07:02:08,656 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-14 07:02:08,665 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-09-14 07:02:08,666 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1e9a36275e8fecd9f9c834fc560292b8, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694674928649.1e9a36275e8fecd9f9c834fc560292b8.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp 2023-09-14 07:02:08,667 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => f3c2cf412c9fb3441ecc99857ce7bd6b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1694674928649.f3c2cf412c9fb3441ecc99857ce7bd6b.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp 2023-09-14 07:02:08,674 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1694674928649.f3c2cf412c9fb3441ecc99857ce7bd6b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 07:02:08,674 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing f3c2cf412c9fb3441ecc99857ce7bd6b, disabling compactions & flushes 2023-09-14 07:02:08,674 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1694674928649.f3c2cf412c9fb3441ecc99857ce7bd6b. 2023-09-14 07:02:08,674 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1694674928649.f3c2cf412c9fb3441ecc99857ce7bd6b. 2023-09-14 07:02:08,674 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1694674928649.f3c2cf412c9fb3441ecc99857ce7bd6b. after waiting 0 ms 2023-09-14 07:02:08,674 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1694674928649.1e9a36275e8fecd9f9c834fc560292b8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 07:02:08,674 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1694674928649.f3c2cf412c9fb3441ecc99857ce7bd6b. 2023-09-14 07:02:08,674 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 1e9a36275e8fecd9f9c834fc560292b8, disabling compactions & flushes 2023-09-14 07:02:08,674 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1694674928649.f3c2cf412c9fb3441ecc99857ce7bd6b. 2023-09-14 07:02:08,674 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1694674928649.1e9a36275e8fecd9f9c834fc560292b8. 2023-09-14 07:02:08,675 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694674928649.1e9a36275e8fecd9f9c834fc560292b8. 2023-09-14 07:02:08,674 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for f3c2cf412c9fb3441ecc99857ce7bd6b: 2023-09-14 07:02:08,675 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694674928649.1e9a36275e8fecd9f9c834fc560292b8. after waiting 0 ms 2023-09-14 07:02:08,675 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1694674928649.1e9a36275e8fecd9f9c834fc560292b8. 2023-09-14 07:02:08,675 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1694674928649.1e9a36275e8fecd9f9c834fc560292b8. 2023-09-14 07:02:08,675 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 1e9a36275e8fecd9f9c834fc560292b8: 2023-09-14 07:02:08,677 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-09-14 07:02:08,678 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694674928649.f3c2cf412c9fb3441ecc99857ce7bd6b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694674928677"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694674928677"}]},"ts":"1694674928677"} 2023-09-14 07:02:08,678 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694674928649.1e9a36275e8fecd9f9c834fc560292b8.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694674928677"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694674928677"}]},"ts":"1694674928677"} 2023-09-14 07:02:08,680 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-14 07:02:08,680 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-14 07:02:08,680 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694674928680"}]},"ts":"1694674928680"} 2023-09-14 07:02:08,682 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-09-14 07:02:08,685 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-14 07:02:08,686 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-14 07:02:08,686 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-14 07:02:08,686 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-14 07:02:08,686 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-14 07:02:08,686 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1e9a36275e8fecd9f9c834fc560292b8, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f3c2cf412c9fb3441ecc99857ce7bd6b, ASSIGN}] 2023-09-14 07:02:08,688 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1e9a36275e8fecd9f9c834fc560292b8, ASSIGN 2023-09-14 07:02:08,688 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f3c2cf412c9fb3441ecc99857ce7bd6b, ASSIGN 2023-09-14 07:02:08,689 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1e9a36275e8fecd9f9c834fc560292b8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35941,1694674856649; forceNewPlan=false, retain=false 2023-09-14 07:02:08,689 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f3c2cf412c9fb3441ecc99857ce7bd6b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41005,1694674856735; forceNewPlan=false, retain=false 2023-09-14 07:02:08,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-14 07:02:08,839 INFO [jenkins-hbase4:33055] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-14 07:02:08,842 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=f3c2cf412c9fb3441ecc99857ce7bd6b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:08,842 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=1e9a36275e8fecd9f9c834fc560292b8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:08,843 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694674928649.1e9a36275e8fecd9f9c834fc560292b8.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694674928842"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694674928842"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694674928842"}]},"ts":"1694674928842"} 2023-09-14 07:02:08,843 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694674928649.f3c2cf412c9fb3441ecc99857ce7bd6b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694674928842"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694674928842"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694674928842"}]},"ts":"1694674928842"} 2023-09-14 07:02:08,844 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure f3c2cf412c9fb3441ecc99857ce7bd6b, server=jenkins-hbase4.apache.org,41005,1694674856735}] 2023-09-14 07:02:08,845 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure 1e9a36275e8fecd9f9c834fc560292b8, server=jenkins-hbase4.apache.org,35941,1694674856649}] 2023-09-14 07:02:08,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-14 07:02:08,999 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1694674928649.1e9a36275e8fecd9f9c834fc560292b8. 2023-09-14 07:02:08,999 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1694674928649.f3c2cf412c9fb3441ecc99857ce7bd6b. 2023-09-14 07:02:08,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1e9a36275e8fecd9f9c834fc560292b8, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694674928649.1e9a36275e8fecd9f9c834fc560292b8.', STARTKEY => '', ENDKEY => '2'} 2023-09-14 07:02:09,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f3c2cf412c9fb3441ecc99857ce7bd6b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1694674928649.f3c2cf412c9fb3441ecc99857ce7bd6b.', STARTKEY => '2', ENDKEY => ''} 2023-09-14 07:02:09,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1694674928649.1e9a36275e8fecd9f9c834fc560292b8. service=AccessControlService 2023-09-14 07:02:09,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1694674928649.f3c2cf412c9fb3441ecc99857ce7bd6b. service=AccessControlService 2023-09-14 07:02:09,000 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-14 07:02:09,000 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-14 07:02:09,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 f3c2cf412c9fb3441ecc99857ce7bd6b 2023-09-14 07:02:09,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 1e9a36275e8fecd9f9c834fc560292b8 2023-09-14 07:02:09,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1694674928649.f3c2cf412c9fb3441ecc99857ce7bd6b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 07:02:09,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1694674928649.1e9a36275e8fecd9f9c834fc560292b8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 07:02:09,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f3c2cf412c9fb3441ecc99857ce7bd6b 2023-09-14 07:02:09,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1e9a36275e8fecd9f9c834fc560292b8 2023-09-14 07:02:09,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f3c2cf412c9fb3441ecc99857ce7bd6b 2023-09-14 07:02:09,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1e9a36275e8fecd9f9c834fc560292b8 2023-09-14 07:02:09,002 INFO [StoreOpener-f3c2cf412c9fb3441ecc99857ce7bd6b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f3c2cf412c9fb3441ecc99857ce7bd6b 2023-09-14 07:02:09,002 INFO [StoreOpener-1e9a36275e8fecd9f9c834fc560292b8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1e9a36275e8fecd9f9c834fc560292b8 2023-09-14 07:02:09,003 DEBUG [StoreOpener-f3c2cf412c9fb3441ecc99857ce7bd6b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3c2cf412c9fb3441ecc99857ce7bd6b/cf 2023-09-14 07:02:09,004 DEBUG [StoreOpener-1e9a36275e8fecd9f9c834fc560292b8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e9a36275e8fecd9f9c834fc560292b8/cf 2023-09-14 07:02:09,004 DEBUG [StoreOpener-1e9a36275e8fecd9f9c834fc560292b8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e9a36275e8fecd9f9c834fc560292b8/cf 2023-09-14 07:02:09,004 DEBUG [StoreOpener-f3c2cf412c9fb3441ecc99857ce7bd6b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3c2cf412c9fb3441ecc99857ce7bd6b/cf 2023-09-14 07:02:09,004 INFO [StoreOpener-1e9a36275e8fecd9f9c834fc560292b8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1e9a36275e8fecd9f9c834fc560292b8 columnFamilyName cf 2023-09-14 07:02:09,004 INFO [StoreOpener-f3c2cf412c9fb3441ecc99857ce7bd6b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f3c2cf412c9fb3441ecc99857ce7bd6b columnFamilyName cf 2023-09-14 07:02:09,005 INFO [StoreOpener-1e9a36275e8fecd9f9c834fc560292b8-1] regionserver.HStore(310): Store=1e9a36275e8fecd9f9c834fc560292b8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-14 07:02:09,005 INFO [StoreOpener-f3c2cf412c9fb3441ecc99857ce7bd6b-1] regionserver.HStore(310): Store=f3c2cf412c9fb3441ecc99857ce7bd6b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-14 07:02:09,006 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e9a36275e8fecd9f9c834fc560292b8 2023-09-14 07:02:09,006 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3c2cf412c9fb3441ecc99857ce7bd6b 2023-09-14 07:02:09,006 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e9a36275e8fecd9f9c834fc560292b8 2023-09-14 07:02:09,006 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3c2cf412c9fb3441ecc99857ce7bd6b 2023-09-14 07:02:09,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1e9a36275e8fecd9f9c834fc560292b8 2023-09-14 07:02:09,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f3c2cf412c9fb3441ecc99857ce7bd6b 2023-09-14 07:02:09,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e9a36275e8fecd9f9c834fc560292b8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-14 07:02:09,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3c2cf412c9fb3441ecc99857ce7bd6b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-14 07:02:09,011 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1e9a36275e8fecd9f9c834fc560292b8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61915575, jitterRate=-0.0773860365152359}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-14 07:02:09,011 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f3c2cf412c9fb3441ecc99857ce7bd6b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68221066, jitterRate=0.01657310128211975}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-14 07:02:09,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1e9a36275e8fecd9f9c834fc560292b8: 2023-09-14 07:02:09,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f3c2cf412c9fb3441ecc99857ce7bd6b: 2023-09-14 07:02:09,012 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1694674928649.f3c2cf412c9fb3441ecc99857ce7bd6b., pid=69, masterSystemTime=1694674928996 2023-09-14 07:02:09,012 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1694674928649.1e9a36275e8fecd9f9c834fc560292b8., pid=70, masterSystemTime=1694674928996 2023-09-14 07:02:09,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1694674928649.f3c2cf412c9fb3441ecc99857ce7bd6b. 2023-09-14 07:02:09,014 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1694674928649.f3c2cf412c9fb3441ecc99857ce7bd6b. 2023-09-14 07:02:09,014 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=f3c2cf412c9fb3441ecc99857ce7bd6b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:09,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1694674928649.1e9a36275e8fecd9f9c834fc560292b8. 2023-09-14 07:02:09,014 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694674928649.f3c2cf412c9fb3441ecc99857ce7bd6b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694674929014"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694674929014"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694674929014"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694674929014"}]},"ts":"1694674929014"} 2023-09-14 07:02:09,014 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1694674928649.1e9a36275e8fecd9f9c834fc560292b8. 2023-09-14 07:02:09,015 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=1e9a36275e8fecd9f9c834fc560292b8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:09,015 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694674928649.1e9a36275e8fecd9f9c834fc560292b8.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694674929015"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694674929015"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694674929015"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694674929015"}]},"ts":"1694674929015"} 2023-09-14 07:02:09,018 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=68 2023-09-14 07:02:09,018 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure f3c2cf412c9fb3441ecc99857ce7bd6b, server=jenkins-hbase4.apache.org,41005,1694674856735 in 172 msec 2023-09-14 07:02:09,019 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=67 2023-09-14 07:02:09,019 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure 1e9a36275e8fecd9f9c834fc560292b8, server=jenkins-hbase4.apache.org,35941,1694674856649 in 172 msec 2023-09-14 07:02:09,019 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f3c2cf412c9fb3441ecc99857ce7bd6b, ASSIGN in 332 msec 2023-09-14 07:02:09,021 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=67, resume processing ppid=66 2023-09-14 07:02:09,021 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1e9a36275e8fecd9f9c834fc560292b8, ASSIGN in 333 msec 2023-09-14 07:02:09,021 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-14 07:02:09,021 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694674929021"}]},"ts":"1694674929021"} 2023-09-14 07:02:09,023 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-09-14 07:02:09,025 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-09-14 07:02:09,025 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-09-14 07:02:09,027 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35941] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-14 07:02:09,029 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 07:02:09,029 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 07:02:09,029 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 07:02:09,029 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 07:02:09,031 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-14 07:02:09,031 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-14 07:02:09,031 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-14 07:02:09,031 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-14 07:02:09,031 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-14 07:02:09,031 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-14 07:02:09,031 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-14 07:02:09,031 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-14 07:02:09,032 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 381 msec 2023-09-14 07:02:09,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-14 07:02:09,256 INFO [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-09-14 07:02:09,277 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 1e9a36275e8fecd9f9c834fc560292b8, f3c2cf412c9fb3441ecc99857ce7bd6b 2023-09-14 07:02:09,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[1e9a36275e8fecd9f9c834fc560292b8, f3c2cf412c9fb3441ecc99857ce7bd6b], force=true 2023-09-14 07:02:09,287 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[1e9a36275e8fecd9f9c834fc560292b8, f3c2cf412c9fb3441ecc99857ce7bd6b], force=true 2023-09-14 07:02:09,287 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[1e9a36275e8fecd9f9c834fc560292b8, f3c2cf412c9fb3441ecc99857ce7bd6b], force=true 2023-09-14 07:02:09,287 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[1e9a36275e8fecd9f9c834fc560292b8, f3c2cf412c9fb3441ecc99857ce7bd6b], force=true 2023-09-14 07:02:09,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-14 07:02:09,308 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1e9a36275e8fecd9f9c834fc560292b8, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f3c2cf412c9fb3441ecc99857ce7bd6b, UNASSIGN}] 2023-09-14 07:02:09,310 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1e9a36275e8fecd9f9c834fc560292b8, UNASSIGN 2023-09-14 07:02:09,310 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f3c2cf412c9fb3441ecc99857ce7bd6b, UNASSIGN 2023-09-14 07:02:09,310 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=1e9a36275e8fecd9f9c834fc560292b8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:09,310 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=f3c2cf412c9fb3441ecc99857ce7bd6b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:09,310 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694674928649.1e9a36275e8fecd9f9c834fc560292b8.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694674929310"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694674929310"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694674929310"}]},"ts":"1694674929310"} 2023-09-14 07:02:09,311 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694674928649.f3c2cf412c9fb3441ecc99857ce7bd6b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694674929310"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694674929310"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694674929310"}]},"ts":"1694674929310"} 2023-09-14 07:02:09,312 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 1e9a36275e8fecd9f9c834fc560292b8, server=jenkins-hbase4.apache.org,35941,1694674856649}] 2023-09-14 07:02:09,313 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure f3c2cf412c9fb3441ecc99857ce7bd6b, server=jenkins-hbase4.apache.org,41005,1694674856735}] 2023-09-14 07:02:09,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-14 07:02:09,464 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1e9a36275e8fecd9f9c834fc560292b8 2023-09-14 07:02:09,464 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f3c2cf412c9fb3441ecc99857ce7bd6b 2023-09-14 07:02:09,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1e9a36275e8fecd9f9c834fc560292b8, disabling compactions & flushes 2023-09-14 07:02:09,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f3c2cf412c9fb3441ecc99857ce7bd6b, disabling compactions & flushes 2023-09-14 07:02:09,466 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1694674928649.1e9a36275e8fecd9f9c834fc560292b8. 2023-09-14 07:02:09,466 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1694674928649.f3c2cf412c9fb3441ecc99857ce7bd6b. 2023-09-14 07:02:09,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1694674928649.f3c2cf412c9fb3441ecc99857ce7bd6b. 2023-09-14 07:02:09,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694674928649.1e9a36275e8fecd9f9c834fc560292b8. 2023-09-14 07:02:09,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1694674928649.f3c2cf412c9fb3441ecc99857ce7bd6b. after waiting 0 ms 2023-09-14 07:02:09,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1694674928649.f3c2cf412c9fb3441ecc99857ce7bd6b. 2023-09-14 07:02:09,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694674928649.1e9a36275e8fecd9f9c834fc560292b8. after waiting 0 ms 2023-09-14 07:02:09,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1694674928649.1e9a36275e8fecd9f9c834fc560292b8. 2023-09-14 07:02:09,466 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing f3c2cf412c9fb3441ecc99857ce7bd6b 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-14 07:02:09,466 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1e9a36275e8fecd9f9c834fc560292b8 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-14 07:02:09,483 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3c2cf412c9fb3441ecc99857ce7bd6b/.tmp/cf/ce4f2f87f47946dd83bc8bb43a5ddba5 2023-09-14 07:02:09,485 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e9a36275e8fecd9f9c834fc560292b8/.tmp/cf/bb231cc9c6bf4ce5a9569c2b9b2622c8 2023-09-14 07:02:09,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3c2cf412c9fb3441ecc99857ce7bd6b/.tmp/cf/ce4f2f87f47946dd83bc8bb43a5ddba5 as hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3c2cf412c9fb3441ecc99857ce7bd6b/cf/ce4f2f87f47946dd83bc8bb43a5ddba5 2023-09-14 07:02:09,490 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e9a36275e8fecd9f9c834fc560292b8/.tmp/cf/bb231cc9c6bf4ce5a9569c2b9b2622c8 as hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e9a36275e8fecd9f9c834fc560292b8/cf/bb231cc9c6bf4ce5a9569c2b9b2622c8 2023-09-14 07:02:09,494 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3c2cf412c9fb3441ecc99857ce7bd6b/cf/ce4f2f87f47946dd83bc8bb43a5ddba5, entries=1, sequenceid=5, filesize=4.7 K 2023-09-14 07:02:09,495 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for f3c2cf412c9fb3441ecc99857ce7bd6b in 28ms, sequenceid=5, compaction requested=false 2023-09-14 07:02:09,495 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-14 07:02:09,495 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e9a36275e8fecd9f9c834fc560292b8/cf/bb231cc9c6bf4ce5a9569c2b9b2622c8, entries=1, sequenceid=5, filesize=4.7 K 2023-09-14 07:02:09,500 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 1e9a36275e8fecd9f9c834fc560292b8 in 34ms, sequenceid=5, compaction requested=false 2023-09-14 07:02:09,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e9a36275e8fecd9f9c834fc560292b8/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-14 07:02:09,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3c2cf412c9fb3441ecc99857ce7bd6b/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-14 07:02:09,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-14 07:02:09,507 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1694674928649.1e9a36275e8fecd9f9c834fc560292b8. 2023-09-14 07:02:09,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-14 07:02:09,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1e9a36275e8fecd9f9c834fc560292b8: 2023-09-14 07:02:09,507 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1694674928649.f3c2cf412c9fb3441ecc99857ce7bd6b. 2023-09-14 07:02:09,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f3c2cf412c9fb3441ecc99857ce7bd6b: 2023-09-14 07:02:09,509 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f3c2cf412c9fb3441ecc99857ce7bd6b 2023-09-14 07:02:09,509 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=f3c2cf412c9fb3441ecc99857ce7bd6b, regionState=CLOSED 2023-09-14 07:02:09,509 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694674928649.f3c2cf412c9fb3441ecc99857ce7bd6b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694674929509"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694674929509"}]},"ts":"1694674929509"} 2023-09-14 07:02:09,509 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1e9a36275e8fecd9f9c834fc560292b8 2023-09-14 07:02:09,510 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=1e9a36275e8fecd9f9c834fc560292b8, regionState=CLOSED 2023-09-14 07:02:09,510 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694674928649.1e9a36275e8fecd9f9c834fc560292b8.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694674929510"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694674929510"}]},"ts":"1694674929510"} 2023-09-14 07:02:09,512 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=73 2023-09-14 07:02:09,512 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure f3c2cf412c9fb3441ecc99857ce7bd6b, server=jenkins-hbase4.apache.org,41005,1694674856735 in 198 msec 2023-09-14 07:02:09,513 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=72 2023-09-14 07:02:09,513 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 1e9a36275e8fecd9f9c834fc560292b8, server=jenkins-hbase4.apache.org,35941,1694674856649 in 199 msec 2023-09-14 07:02:09,513 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f3c2cf412c9fb3441ecc99857ce7bd6b, UNASSIGN in 204 msec 2023-09-14 07:02:09,514 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-09-14 07:02:09,514 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1e9a36275e8fecd9f9c834fc560292b8, UNASSIGN in 208 msec 2023-09-14 07:02:09,558 DEBUG [PEWorker-3] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d1399373434f762c05030566738eb3a2/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-09-14 07:02:09,559 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694674928649.1e9a36275e8fecd9f9c834fc560292b8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-14 07:02:09,560 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694674928649.f3c2cf412c9fb3441ecc99857ce7bd6b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-14 07:02:09,560 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694674928650.d1399373434f762c05030566738eb3a2.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-14 07:02:09,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-14 07:02:09,608 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d1399373434f762c05030566738eb3a2, ASSIGN}] 2023-09-14 07:02:09,609 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d1399373434f762c05030566738eb3a2, ASSIGN 2023-09-14 07:02:09,609 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d1399373434f762c05030566738eb3a2, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,35941,1694674856649; forceNewPlan=false, retain=false 2023-09-14 07:02:09,760 INFO [jenkins-hbase4:33055] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-14 07:02:09,761 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=d1399373434f762c05030566738eb3a2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:09,761 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694674928650.d1399373434f762c05030566738eb3a2.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1694674929761"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694674929761"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694674929761"}]},"ts":"1694674929761"} 2023-09-14 07:02:09,763 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure d1399373434f762c05030566738eb3a2, server=jenkins-hbase4.apache.org,35941,1694674856649}] 2023-09-14 07:02:09,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-14 07:02:09,918 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1694674928650.d1399373434f762c05030566738eb3a2. 2023-09-14 07:02:09,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d1399373434f762c05030566738eb3a2, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694674928650.d1399373434f762c05030566738eb3a2.', STARTKEY => '', ENDKEY => ''} 2023-09-14 07:02:09,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1694674928650.d1399373434f762c05030566738eb3a2. service=AccessControlService 2023-09-14 07:02:09,918 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-14 07:02:09,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 d1399373434f762c05030566738eb3a2 2023-09-14 07:02:09,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1694674928650.d1399373434f762c05030566738eb3a2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 07:02:09,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d1399373434f762c05030566738eb3a2 2023-09-14 07:02:09,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d1399373434f762c05030566738eb3a2 2023-09-14 07:02:09,920 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d1399373434f762c05030566738eb3a2/.regioninfo 2023-09-14 07:02:09,928 INFO [StoreOpener-d1399373434f762c05030566738eb3a2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d1399373434f762c05030566738eb3a2 2023-09-14 07:02:09,929 DEBUG [StoreOpener-d1399373434f762c05030566738eb3a2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d1399373434f762c05030566738eb3a2/cf 2023-09-14 07:02:09,929 DEBUG [StoreOpener-d1399373434f762c05030566738eb3a2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d1399373434f762c05030566738eb3a2/cf 2023-09-14 07:02:09,930 INFO [StoreOpener-d1399373434f762c05030566738eb3a2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d1399373434f762c05030566738eb3a2 columnFamilyName cf 2023-09-14 07:02:09,957 DEBUG [StoreOpener-d1399373434f762c05030566738eb3a2-1] regionserver.HStore(539): loaded hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d1399373434f762c05030566738eb3a2/cf/bb231cc9c6bf4ce5a9569c2b9b2622c8.1e9a36275e8fecd9f9c834fc560292b8->hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e9a36275e8fecd9f9c834fc560292b8/cf/bb231cc9c6bf4ce5a9569c2b9b2622c8-top 2023-09-14 07:02:09,962 DEBUG [StoreOpener-d1399373434f762c05030566738eb3a2-1] regionserver.HStore(539): loaded hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d1399373434f762c05030566738eb3a2/cf/ce4f2f87f47946dd83bc8bb43a5ddba5.f3c2cf412c9fb3441ecc99857ce7bd6b->hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3c2cf412c9fb3441ecc99857ce7bd6b/cf/ce4f2f87f47946dd83bc8bb43a5ddba5-top 2023-09-14 07:02:09,963 INFO [StoreOpener-d1399373434f762c05030566738eb3a2-1] regionserver.HStore(310): Store=d1399373434f762c05030566738eb3a2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-14 07:02:09,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d1399373434f762c05030566738eb3a2 2023-09-14 07:02:09,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d1399373434f762c05030566738eb3a2 2023-09-14 07:02:09,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d1399373434f762c05030566738eb3a2 2023-09-14 07:02:09,968 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d1399373434f762c05030566738eb3a2; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73433248, jitterRate=0.09424066543579102}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-14 07:02:09,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d1399373434f762c05030566738eb3a2: 2023-09-14 07:02:09,969 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1694674928650.d1399373434f762c05030566738eb3a2., pid=77, masterSystemTime=1694674929915 2023-09-14 07:02:09,970 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1694674928650.d1399373434f762c05030566738eb3a2.,because compaction is disabled. 2023-09-14 07:02:09,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1694674928650.d1399373434f762c05030566738eb3a2. 2023-09-14 07:02:09,971 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1694674928650.d1399373434f762c05030566738eb3a2. 2023-09-14 07:02:09,972 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=d1399373434f762c05030566738eb3a2, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:09,972 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694674928650.d1399373434f762c05030566738eb3a2.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1694674929971"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694674929971"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694674929971"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694674929971"}]},"ts":"1694674929971"} 2023-09-14 07:02:09,975 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-09-14 07:02:09,975 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure d1399373434f762c05030566738eb3a2, server=jenkins-hbase4.apache.org,35941,1694674856649 in 210 msec 2023-09-14 07:02:09,976 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-09-14 07:02:09,976 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d1399373434f762c05030566738eb3a2, ASSIGN in 367 msec 2023-09-14 07:02:09,978 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[1e9a36275e8fecd9f9c834fc560292b8, f3c2cf412c9fb3441ecc99857ce7bd6b], force=true in 696 msec 2023-09-14 07:02:10,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-14 07:02:10,395 INFO [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-09-14 07:02:10,395 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-14 07:02:10,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694674930395 (current time:1694674930395). 2023-09-14 07:02:10,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-14 07:02:10,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] zookeeper.ReadOnlyZKClient(139): Connect 0x21180414 to 127.0.0.1:52295 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 07:02:10,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1999269c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 07:02:10,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 07:02:10,407 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47546, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 07:02:10,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x21180414 to 127.0.0.1:52295 2023-09-14 07:02:10,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 07:02:10,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] zookeeper.ReadOnlyZKClient(139): Connect 0x0e320a83 to 127.0.0.1:52295 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 07:02:10,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6f6b97f5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 07:02:10,416 DEBUG [hconnection-0x3f96f142-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 07:02:10,418 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47560, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 07:02:10,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 07:02:10,424 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41404, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 07:02:10,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0e320a83 to 127.0.0.1:52295 2023-09-14 07:02:10,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 07:02:10,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-14 07:02:10,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-14 07:02:10,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-14 07:02:10,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-14 07:02:10,429 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-14 07:02:10,430 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1694675530430 2023-09-14 07:02:10,430 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-14 07:02:10,433 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-14 07:02:10,433 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-14 07:02:10,434 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-14 07:02:10,433 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-14 07:02:10,435 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 7 msec 2023-09-14 07:02:10,436 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-14 07:02:10,436 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1694675530436 2023-09-14 07:02:10,445 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,445 INFO [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-09-14 07:02:10,445 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 07:02:10,446 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-09-14 07:02:10,446 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-09-14 07:02:10,446 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,446 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,448 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:02:10,448 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:02:10,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:02:10,448 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:10,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:02:10,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:02:10,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:02:10,448 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:02:10,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:02:10,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:02:10,449 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:10,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,449 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-14 07:02:10,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,449 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,449 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,449 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-14 07:02:10,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,450 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-14 07:02:10,450 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,450 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-14 07:02:10,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-14 07:02:10,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-14 07:02:10,450 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-14 07:02:10,450 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 07:02:10,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,451 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-14 07:02:10,451 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,451 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-14 07:02:10,451 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-14 07:02:10,451 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 07:02:10,451 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-14 07:02:10,452 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-14 07:02:10,452 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-14 07:02:10,452 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35941,1694674856649' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-14 07:02:10,451 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41005,1694674856735' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-14 07:02:10,452 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,452 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-14 07:02:10,453 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 07:02:10,453 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-14 07:02:10,453 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-14 07:02:10,453 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37703,1694674856695' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-14 07:02:10,455 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,455 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,455 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:10,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:10,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:02:10,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:02:10,455 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,455 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 07:02:10,456 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:02:10,456 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,456 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 07:02:10,456 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,456 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 07:02:10,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:02:10,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:10,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:10,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:10,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:02:10,458 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35941,1694674856649' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-09-14 07:02:10,458 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e617209[Count = 0] remaining members to acquire global barrier 2023-09-14 07:02:10,458 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-09-14 07:02:10,458 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,459 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,459 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,459 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,459 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:10,459 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-14 07:02:10,459 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-14 07:02:10,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,459 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-14 07:02:10,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,459 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,41005,1694674856735' in zk 2023-09-14 07:02:10,460 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-14 07:02:10,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,460 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-14 07:02:10,460 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-14 07:02:10,460 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-14 07:02:10,460 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-14 07:02:10,460 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,37703,1694674856695' in zk 2023-09-14 07:02:10,460 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1694674928650.d1399373434f762c05030566738eb3a2. 2023-09-14 07:02:10,460 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1694674928650.d1399373434f762c05030566738eb3a2. started... 2023-09-14 07:02:10,461 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d1399373434f762c05030566738eb3a2: 2023-09-14 07:02:10,461 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694674928650.d1399373434f762c05030566738eb3a2.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,461 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-14 07:02:10,461 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d1399373434f762c05030566738eb3a2/cf/bb231cc9c6bf4ce5a9569c2b9b2622c8.1e9a36275e8fecd9f9c834fc560292b8->hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e9a36275e8fecd9f9c834fc560292b8/cf/bb231cc9c6bf4ce5a9569c2b9b2622c8-top, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d1399373434f762c05030566738eb3a2/cf/ce4f2f87f47946dd83bc8bb43a5ddba5.f3c2cf412c9fb3441ecc99857ce7bd6b->hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3c2cf412c9fb3441ecc99857ce7bd6b/cf/ce4f2f87f47946dd83bc8bb43a5ddba5-top] hfiles 2023-09-14 07:02:10,461 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d1399373434f762c05030566738eb3a2/cf/bb231cc9c6bf4ce5a9569c2b9b2622c8.1e9a36275e8fecd9f9c834fc560292b8 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,462 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-14 07:02:10,462 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 07:02:10,462 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-14 07:02:10,463 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d1399373434f762c05030566738eb3a2/cf/ce4f2f87f47946dd83bc8bb43a5ddba5.f3c2cf412c9fb3441ecc99857ce7bd6b for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,464 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-14 07:02:10,464 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 07:02:10,464 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-14 07:02:10,473 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1694674928650.d1399373434f762c05030566738eb3a2. completed. 2023-09-14 07:02:10,473 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1694674928650.d1399373434f762c05030566738eb3a2. 2023-09-14 07:02:10,473 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-14 07:02:10,473 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-14 07:02:10,473 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:10,473 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-14 07:02:10,473 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,35941,1694674856649' in zk 2023-09-14 07:02:10,478 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:10,478 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-14 07:02:10,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:10,478 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 07:02:10,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:02:10,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:02:10,478 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-14 07:02:10,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:02:10,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:02:10,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:10,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:10,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:10,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:02:10,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:10,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:10,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:10,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,35941,1694674856649': 2023-09-14 07:02:10,481 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35941,1694674856649' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-09-14 07:02:10,481 INFO [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-09-14 07:02:10,481 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-14 07:02:10,481 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-14 07:02:10,481 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,481 INFO [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-14 07:02:10,485 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,485 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,485 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:02:10,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:02:10,485 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,485 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:02:10,485 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,485 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,485 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:02:10,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,485 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:02:10,485 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:02:10,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,486 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:10,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:02:10,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:02:10,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:02:10,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:02:10,486 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:10,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:02:10,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:02:10,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:02:10,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,486 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:10,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:10,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:10,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:10,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:02:10,488 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:10,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,488 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:10,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:10,489 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:10,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:10,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:10,492 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:02:10,492 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:02:10,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:02:10,492 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:02:10,492 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:02:10,492 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:10,492 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:02:10,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:02:10,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:02:10,492 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:02:10,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:02:10,492 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:02:10,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:02:10,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:02:10,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:02:10,492 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:10,492 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:10,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:02:10,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:02:10,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:02:10,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:02:10,493 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,493 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:10,494 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,494 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:10,494 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 07:02:10,494 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,494 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:10,494 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,494 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,494 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,495 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,517 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,518 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-09-14 07:02:10,518 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,518 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,519 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1694674930430Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1694674930494 (+64 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1694674930494Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1694674930498 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1694674930508 (+10 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1694674930518 (+10 ms) 2023-09-14 07:02:10,521 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-14 07:02:10,523 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 88 msec 2023-09-14 07:02:10,534 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-14 07:02:10,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-09-14 07:02:10,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-14 07:02:10,535 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/export-test/export-1694674930535 2023-09-14 07:02:10,535 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44283, tgtDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/export-test/export-1694674930535, rawTgtDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/export-test/export-1694674930535, srcFsUri=hdfs://localhost:44283, srcDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04 2023-09-14 07:02:10,558 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44283, inputRoot=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04 2023-09-14 07:02:10,558 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1976888490_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/export-test/export-1694674930535, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/export-test/export-1694674930535/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,558 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44283, inputRoot=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04, snapshotDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-09-14 07:02:10,566 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/export-test/export-1694674930535/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:10,584 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-14 07:02:10,584 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-14 07:02:10,585 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-14 07:02:10,585 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-14 07:02:11,459 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/hadoop-4933087340477690418.jar 2023-09-14 07:02:11,459 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-14 07:02:11,459 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-14 07:02:11,525 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/hadoop-2346515408275656.jar 2023-09-14 07:02:11,526 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-14 07:02:11,526 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-14 07:02:11,526 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-14 07:02:11,527 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-14 07:02:11,527 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-14 07:02:11,527 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-14 07:02:11,528 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-14 07:02:11,528 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-14 07:02:11,529 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-14 07:02:11,529 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-14 07:02:11,529 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-14 07:02:11,530 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-14 07:02:11,530 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-14 07:02:11,530 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-14 07:02:11,531 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-14 07:02:11,531 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-14 07:02:11,532 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 07:02:11,532 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 07:02:11,533 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-14 07:02:11,533 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 07:02:11,533 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 07:02:11,533 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-14 07:02:11,534 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-14 07:02:11,838 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694674863103_0004_000001 (auth:SIMPLE) 2023-09-14 07:02:11,890 WARN [Listener at jenkins-hbase4.apache.org/40843] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-14 07:02:11,892 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-09-14 07:02:11,894 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-09-14 07:02:11,950 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-14 07:02:11,950 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-14 07:02:11,995 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694674863103_0005_000001 (auth:SIMPLE) 2023-09-14 07:02:12,815 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-14 07:02:15,812 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694674863103_0005_000001 (auth:SIMPLE) 2023-09-14 07:02:18,023 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694674863103_0005_000001 (auth:SIMPLE) 2023-09-14 07:02:20,703 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694674863103_0005_000001 (auth:SIMPLE) 2023-09-14 07:02:22,052 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-14 07:02:22,055 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-14 07:02:22,063 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:22,063 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-14 07:02:22,064 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-14 07:02:22,064 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_409472800_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:22,065 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(367): hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-14 07:02:22,065 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(367): hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-14 07:02:22,065 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_409472800_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/export-test/export-1694674930535/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/export-test/export-1694674930535/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:22,065 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(367): hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/export-test/export-1694674930535/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-14 07:02:22,065 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(367): hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/export-test/export-1694674930535/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-14 07:02:22,072 INFO [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:22,072 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:22,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:22,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-14 07:02:22,076 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694674942076"}]},"ts":"1694674942076"} 2023-09-14 07:02:22,077 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-09-14 07:02:22,079 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-09-14 07:02:22,080 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d1399373434f762c05030566738eb3a2, UNASSIGN}] 2023-09-14 07:02:22,082 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d1399373434f762c05030566738eb3a2, UNASSIGN 2023-09-14 07:02:22,082 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=d1399373434f762c05030566738eb3a2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:22,082 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694674928650.d1399373434f762c05030566738eb3a2.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1694674942082"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694674942082"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694674942082"}]},"ts":"1694674942082"} 2023-09-14 07:02:22,084 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure d1399373434f762c05030566738eb3a2, server=jenkins-hbase4.apache.org,35941,1694674856649}] 2023-09-14 07:02:22,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-14 07:02:22,235 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d1399373434f762c05030566738eb3a2 2023-09-14 07:02:22,236 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d1399373434f762c05030566738eb3a2, disabling compactions & flushes 2023-09-14 07:02:22,236 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1694674928650.d1399373434f762c05030566738eb3a2. 2023-09-14 07:02:22,236 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694674928650.d1399373434f762c05030566738eb3a2. 2023-09-14 07:02:22,236 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694674928650.d1399373434f762c05030566738eb3a2. after waiting 0 ms 2023-09-14 07:02:22,236 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1694674928650.d1399373434f762c05030566738eb3a2. 2023-09-14 07:02:22,247 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d1399373434f762c05030566738eb3a2/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-09-14 07:02:22,248 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-14 07:02:22,249 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1694674928650.d1399373434f762c05030566738eb3a2. 2023-09-14 07:02:22,249 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d1399373434f762c05030566738eb3a2: 2023-09-14 07:02:22,250 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d1399373434f762c05030566738eb3a2 2023-09-14 07:02:22,251 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=d1399373434f762c05030566738eb3a2, regionState=CLOSED 2023-09-14 07:02:22,251 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694674928650.d1399373434f762c05030566738eb3a2.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1694674942251"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694674942251"}]},"ts":"1694674942251"} 2023-09-14 07:02:22,254 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-09-14 07:02:22,254 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure d1399373434f762c05030566738eb3a2, server=jenkins-hbase4.apache.org,35941,1694674856649 in 168 msec 2023-09-14 07:02:22,255 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-09-14 07:02:22,255 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d1399373434f762c05030566738eb3a2, UNASSIGN in 174 msec 2023-09-14 07:02:22,256 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694674942256"}]},"ts":"1694674942256"} 2023-09-14 07:02:22,257 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-09-14 07:02:22,259 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-09-14 07:02:22,261 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 188 msec 2023-09-14 07:02:22,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-14 07:02:22,378 INFO [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-09-14 07:02:22,379 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:22,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:22,382 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:22,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:22,383 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:22,384 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35941] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:22,387 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:22,387 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:22,387 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:22,387 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:22,387 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d1399373434f762c05030566738eb3a2 2023-09-14 07:02:22,387 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e9a36275e8fecd9f9c834fc560292b8 2023-09-14 07:02:22,387 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3c2cf412c9fb3441ecc99857ce7bd6b 2023-09-14 07:02:22,387 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-14 07:02:22,388 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-14 07:02:22,388 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-14 07:02:22,388 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-14 07:02:22,389 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:22,389 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:22,389 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:22,389 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 07:02:22,389 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 07:02:22,389 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:22,389 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 07:02:22,389 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 07:02:22,389 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3c2cf412c9fb3441ecc99857ce7bd6b/cf, FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3c2cf412c9fb3441ecc99857ce7bd6b/recovered.edits] 2023-09-14 07:02:22,390 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e9a36275e8fecd9f9c834fc560292b8/cf, FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e9a36275e8fecd9f9c834fc560292b8/recovered.edits] 2023-09-14 07:02:22,390 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-14 07:02:22,390 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-14 07:02:22,390 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-14 07:02:22,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-14 07:02:22,390 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-14 07:02:22,394 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3c2cf412c9fb3441ecc99857ce7bd6b/cf/ce4f2f87f47946dd83bc8bb43a5ddba5 to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3c2cf412c9fb3441ecc99857ce7bd6b/cf/ce4f2f87f47946dd83bc8bb43a5ddba5 2023-09-14 07:02:22,394 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e9a36275e8fecd9f9c834fc560292b8/cf/bb231cc9c6bf4ce5a9569c2b9b2622c8 to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e9a36275e8fecd9f9c834fc560292b8/cf/bb231cc9c6bf4ce5a9569c2b9b2622c8 2023-09-14 07:02:22,395 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d1399373434f762c05030566738eb3a2/cf, FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d1399373434f762c05030566738eb3a2/recovered.edits] 2023-09-14 07:02:22,398 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e9a36275e8fecd9f9c834fc560292b8/recovered.edits/8.seqid to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e9a36275e8fecd9f9c834fc560292b8/recovered.edits/8.seqid 2023-09-14 07:02:22,398 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3c2cf412c9fb3441ecc99857ce7bd6b/recovered.edits/8.seqid to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3c2cf412c9fb3441ecc99857ce7bd6b/recovered.edits/8.seqid 2023-09-14 07:02:22,398 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e9a36275e8fecd9f9c834fc560292b8 2023-09-14 07:02:22,398 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3c2cf412c9fb3441ecc99857ce7bd6b 2023-09-14 07:02:22,399 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d1399373434f762c05030566738eb3a2/cf/bb231cc9c6bf4ce5a9569c2b9b2622c8.1e9a36275e8fecd9f9c834fc560292b8 to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d1399373434f762c05030566738eb3a2/cf/bb231cc9c6bf4ce5a9569c2b9b2622c8.1e9a36275e8fecd9f9c834fc560292b8 2023-09-14 07:02:22,400 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d1399373434f762c05030566738eb3a2/cf/ce4f2f87f47946dd83bc8bb43a5ddba5.f3c2cf412c9fb3441ecc99857ce7bd6b to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d1399373434f762c05030566738eb3a2/cf/ce4f2f87f47946dd83bc8bb43a5ddba5.f3c2cf412c9fb3441ecc99857ce7bd6b 2023-09-14 07:02:22,402 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d1399373434f762c05030566738eb3a2/recovered.edits/12.seqid to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d1399373434f762c05030566738eb3a2/recovered.edits/12.seqid 2023-09-14 07:02:22,403 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d1399373434f762c05030566738eb3a2 2023-09-14 07:02:22,403 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-14 07:02:22,405 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:22,407 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-09-14 07:02:22,409 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-09-14 07:02:22,409 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:22,410 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-09-14 07:02:22,410 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694674928650.d1399373434f762c05030566738eb3a2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694674942410"}]},"ts":"9223372036854775807"} 2023-09-14 07:02:22,411 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-09-14 07:02:22,411 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d1399373434f762c05030566738eb3a2, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694674928650.d1399373434f762c05030566738eb3a2.', STARTKEY => '', ENDKEY => ''}] 2023-09-14 07:02:22,411 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-09-14 07:02:22,411 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694674942411"}]},"ts":"9223372036854775807"} 2023-09-14 07:02:22,413 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-09-14 07:02:22,415 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:22,416 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 36 msec 2023-09-14 07:02:22,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-14 07:02:22,492 INFO [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-09-14 07:02:22,492 INFO [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:22,493 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:22,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:22,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-14 07:02:22,497 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694674942497"}]},"ts":"1694674942497"} 2023-09-14 07:02:22,498 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-09-14 07:02:22,500 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-09-14 07:02:22,500 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=5af0873ae06df6e9d1832003ba7e51f6, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=4e4922dd21c5b19c92845fc3c574d451, UNASSIGN}] 2023-09-14 07:02:22,502 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=5af0873ae06df6e9d1832003ba7e51f6, UNASSIGN 2023-09-14 07:02:22,502 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=4e4922dd21c5b19c92845fc3c574d451, UNASSIGN 2023-09-14 07:02:22,503 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=5af0873ae06df6e9d1832003ba7e51f6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:22,503 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=4e4922dd21c5b19c92845fc3c574d451, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:22,503 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694674927489.5af0873ae06df6e9d1832003ba7e51f6.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694674942503"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694674942503"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694674942503"}]},"ts":"1694674942503"} 2023-09-14 07:02:22,503 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694674927489.4e4922dd21c5b19c92845fc3c574d451.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694674942503"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694674942503"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694674942503"}]},"ts":"1694674942503"} 2023-09-14 07:02:22,505 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 5af0873ae06df6e9d1832003ba7e51f6, server=jenkins-hbase4.apache.org,35941,1694674856649}] 2023-09-14 07:02:22,505 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 4e4922dd21c5b19c92845fc3c574d451, server=jenkins-hbase4.apache.org,37703,1694674856695}] 2023-09-14 07:02:22,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-14 07:02:22,657 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5af0873ae06df6e9d1832003ba7e51f6 2023-09-14 07:02:22,657 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5af0873ae06df6e9d1832003ba7e51f6, disabling compactions & flushes 2023-09-14 07:02:22,657 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1694674927489.5af0873ae06df6e9d1832003ba7e51f6. 2023-09-14 07:02:22,657 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1694674927489.5af0873ae06df6e9d1832003ba7e51f6. 2023-09-14 07:02:22,657 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1694674927489.5af0873ae06df6e9d1832003ba7e51f6. after waiting 0 ms 2023-09-14 07:02:22,657 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1694674927489.5af0873ae06df6e9d1832003ba7e51f6. 2023-09-14 07:02:22,659 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4e4922dd21c5b19c92845fc3c574d451 2023-09-14 07:02:22,661 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4e4922dd21c5b19c92845fc3c574d451, disabling compactions & flushes 2023-09-14 07:02:22,661 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1694674927489.4e4922dd21c5b19c92845fc3c574d451. 2023-09-14 07:02:22,661 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1694674927489.4e4922dd21c5b19c92845fc3c574d451. 2023-09-14 07:02:22,661 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1694674927489.4e4922dd21c5b19c92845fc3c574d451. after waiting 0 ms 2023-09-14 07:02:22,661 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1694674927489.4e4922dd21c5b19c92845fc3c574d451. 2023-09-14 07:02:22,667 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion/5af0873ae06df6e9d1832003ba7e51f6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-14 07:02:22,668 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-14 07:02:22,668 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithMergeRegion/4e4922dd21c5b19c92845fc3c574d451/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-14 07:02:22,669 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1694674927489.5af0873ae06df6e9d1832003ba7e51f6. 2023-09-14 07:02:22,669 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5af0873ae06df6e9d1832003ba7e51f6: 2023-09-14 07:02:22,669 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-14 07:02:22,670 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1694674927489.4e4922dd21c5b19c92845fc3c574d451. 2023-09-14 07:02:22,670 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4e4922dd21c5b19c92845fc3c574d451: 2023-09-14 07:02:22,671 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5af0873ae06df6e9d1832003ba7e51f6 2023-09-14 07:02:22,671 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=5af0873ae06df6e9d1832003ba7e51f6, regionState=CLOSED 2023-09-14 07:02:22,671 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694674927489.5af0873ae06df6e9d1832003ba7e51f6.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694674942671"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694674942671"}]},"ts":"1694674942671"} 2023-09-14 07:02:22,671 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4e4922dd21c5b19c92845fc3c574d451 2023-09-14 07:02:22,672 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=4e4922dd21c5b19c92845fc3c574d451, regionState=CLOSED 2023-09-14 07:02:22,672 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694674927489.4e4922dd21c5b19c92845fc3c574d451.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694674942672"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694674942672"}]},"ts":"1694674942672"} 2023-09-14 07:02:22,674 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=85 2023-09-14 07:02:22,674 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 5af0873ae06df6e9d1832003ba7e51f6, server=jenkins-hbase4.apache.org,35941,1694674856649 in 168 msec 2023-09-14 07:02:22,675 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=86 2023-09-14 07:02:22,675 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 4e4922dd21c5b19c92845fc3c574d451, server=jenkins-hbase4.apache.org,37703,1694674856695 in 168 msec 2023-09-14 07:02:22,675 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=5af0873ae06df6e9d1832003ba7e51f6, UNASSIGN in 174 msec 2023-09-14 07:02:22,676 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=86, resume processing ppid=84 2023-09-14 07:02:22,676 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=4e4922dd21c5b19c92845fc3c574d451, UNASSIGN in 175 msec 2023-09-14 07:02:22,676 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694674942676"}]},"ts":"1694674942676"} 2023-09-14 07:02:22,677 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-09-14 07:02:22,679 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-09-14 07:02:22,680 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 186 msec 2023-09-14 07:02:22,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-14 07:02:22,799 INFO [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-09-14 07:02:22,800 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:22,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:22,803 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:22,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:22,804 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:22,805 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35941] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:22,808 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5af0873ae06df6e9d1832003ba7e51f6 2023-09-14 07:02:22,808 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/4e4922dd21c5b19c92845fc3c574d451 2023-09-14 07:02:22,809 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:22,809 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:22,809 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:22,809 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:22,809 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-14 07:02:22,809 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-14 07:02:22,810 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-14 07:02:22,810 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-14 07:02:22,810 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5af0873ae06df6e9d1832003ba7e51f6/cf, FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5af0873ae06df6e9d1832003ba7e51f6/recovered.edits] 2023-09-14 07:02:22,810 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/4e4922dd21c5b19c92845fc3c574d451/cf, FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/4e4922dd21c5b19c92845fc3c574d451/recovered.edits] 2023-09-14 07:02:22,810 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:22,810 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:22,810 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:22,810 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 07:02:22,810 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:22,810 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 07:02:22,810 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 07:02:22,811 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 07:02:22,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-14 07:02:22,814 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5af0873ae06df6e9d1832003ba7e51f6/cf/4f575e4654834c91a67e6c19b08eebef to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/5af0873ae06df6e9d1832003ba7e51f6/cf/4f575e4654834c91a67e6c19b08eebef 2023-09-14 07:02:22,814 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/4e4922dd21c5b19c92845fc3c574d451/cf/70e176724ecb419bb41c61bcecd636f9 to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/4e4922dd21c5b19c92845fc3c574d451/cf/70e176724ecb419bb41c61bcecd636f9 2023-09-14 07:02:22,817 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5af0873ae06df6e9d1832003ba7e51f6/recovered.edits/9.seqid to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/5af0873ae06df6e9d1832003ba7e51f6/recovered.edits/9.seqid 2023-09-14 07:02:22,817 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/4e4922dd21c5b19c92845fc3c574d451/recovered.edits/9.seqid to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/4e4922dd21c5b19c92845fc3c574d451/recovered.edits/9.seqid 2023-09-14 07:02:22,817 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5af0873ae06df6e9d1832003ba7e51f6 2023-09-14 07:02:22,817 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/4e4922dd21c5b19c92845fc3c574d451 2023-09-14 07:02:22,817 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-14 07:02:22,818 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-14 07:02:22,818 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-09-14 07:02:22,821 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202309142b324e443c3e4d8f9878c71799fed03b to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202309142b324e443c3e4d8f9878c71799fed03b 2023-09-14 07:02:22,822 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230914b1156a179e5440a5a117ffd221c78240 to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230914b1156a179e5440a5a117ffd221c78240 2023-09-14 07:02:22,822 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-14 07:02:22,824 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:22,826 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-09-14 07:02:22,828 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-09-14 07:02:22,829 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:22,829 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-09-14 07:02:22,829 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694674927489.5af0873ae06df6e9d1832003ba7e51f6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694674942829"}]},"ts":"9223372036854775807"} 2023-09-14 07:02:22,829 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694674927489.4e4922dd21c5b19c92845fc3c574d451.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694674942829"}]},"ts":"9223372036854775807"} 2023-09-14 07:02:22,830 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-14 07:02:22,830 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 5af0873ae06df6e9d1832003ba7e51f6, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1694674927489.5af0873ae06df6e9d1832003ba7e51f6.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 4e4922dd21c5b19c92845fc3c574d451, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1694674927489.4e4922dd21c5b19c92845fc3c574d451.', STARTKEY => '1', ENDKEY => ''}] 2023-09-14 07:02:22,830 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-09-14 07:02:22,830 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694674942830"}]},"ts":"9223372036854775807"} 2023-09-14 07:02:22,832 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-09-14 07:02:22,833 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:22,834 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 33 msec 2023-09-14 07:02:22,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-14 07:02:22,913 INFO [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-09-14 07:02:22,921 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-14 07:02:22,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:22,925 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-14 07:02:22,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 07:02:22,928 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-09-14 07:02:22,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 07:02:22,954 INFO [Listener at jenkins-hbase4.apache.org/40843] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=759 (was 753) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1328662543_1 at /127.0.0.1:41496 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1328662543_1 at /127.0.0.1:55522 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3a740ce4-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3953 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x3a740ce4-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_409472800_17 at /127.0.0.1:41500 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3a740ce4-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_409472800_17 at /127.0.0.1:41168 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_409472800_17 at /127.0.0.1:55544 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3a740ce4-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3a740ce4-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3a740ce4-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (698022672) connection to jenkins-hbase4.apache.org/172.31.14.131:45519 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=913 (was 909) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=172 (was 202), ProcessCount=168 (was 168), AvailableMemoryMB=8314 (was 8423) 2023-09-14 07:02:22,954 WARN [Listener at jenkins-hbase4.apache.org/40843] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-09-14 07:02:22,977 INFO [Listener at jenkins-hbase4.apache.org/40843] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=759, OpenFileDescriptor=913, MaxFileDescriptor=60000, SystemLoadAverage=172, ProcessCount=168, AvailableMemoryMB=8314 2023-09-14 07:02:22,977 WARN [Listener at jenkins-hbase4.apache.org/40843] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-09-14 07:02:22,978 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-14 07:02:22,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-14 07:02:22,982 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-14 07:02:22,982 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-09-14 07:02:22,982 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-14 07:02:22,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-14 07:02:22,984 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testEmptyExportFileSystemState/4b90ab8ea97d0359248f1c668c988478 2023-09-14 07:02:22,984 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testEmptyExportFileSystemState/c03b1e23cf4b29999a350af121c34f62 2023-09-14 07:02:22,985 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testEmptyExportFileSystemState/4b90ab8ea97d0359248f1c668c988478 empty. 2023-09-14 07:02:22,985 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testEmptyExportFileSystemState/c03b1e23cf4b29999a350af121c34f62 empty. 2023-09-14 07:02:22,985 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testEmptyExportFileSystemState/4b90ab8ea97d0359248f1c668c988478 2023-09-14 07:02:22,985 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testEmptyExportFileSystemState/c03b1e23cf4b29999a350af121c34f62 2023-09-14 07:02:22,985 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-14 07:02:22,994 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-14 07:02:22,995 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4b90ab8ea97d0359248f1c668c988478, NAME => 'testtb-testEmptyExportFileSystemState,,1694674942978.4b90ab8ea97d0359248f1c668c988478.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp 2023-09-14 07:02:22,996 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => c03b1e23cf4b29999a350af121c34f62, NAME => 'testtb-testEmptyExportFileSystemState,1,1694674942978.c03b1e23cf4b29999a350af121c34f62.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp 2023-09-14 07:02:23,003 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1694674942978.c03b1e23cf4b29999a350af121c34f62.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 07:02:23,003 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing c03b1e23cf4b29999a350af121c34f62, disabling compactions & flushes 2023-09-14 07:02:23,003 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1694674942978.c03b1e23cf4b29999a350af121c34f62. 2023-09-14 07:02:23,003 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1694674942978.c03b1e23cf4b29999a350af121c34f62. 2023-09-14 07:02:23,003 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1694674942978.c03b1e23cf4b29999a350af121c34f62. after waiting 0 ms 2023-09-14 07:02:23,003 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1694674942978.4b90ab8ea97d0359248f1c668c988478.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 07:02:23,003 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1694674942978.c03b1e23cf4b29999a350af121c34f62. 2023-09-14 07:02:23,003 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 4b90ab8ea97d0359248f1c668c988478, disabling compactions & flushes 2023-09-14 07:02:23,003 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1694674942978.c03b1e23cf4b29999a350af121c34f62. 2023-09-14 07:02:23,003 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1694674942978.4b90ab8ea97d0359248f1c668c988478. 2023-09-14 07:02:23,004 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1694674942978.4b90ab8ea97d0359248f1c668c988478. 2023-09-14 07:02:23,004 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for c03b1e23cf4b29999a350af121c34f62: 2023-09-14 07:02:23,004 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1694674942978.4b90ab8ea97d0359248f1c668c988478. after waiting 0 ms 2023-09-14 07:02:23,004 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1694674942978.4b90ab8ea97d0359248f1c668c988478. 2023-09-14 07:02:23,004 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1694674942978.4b90ab8ea97d0359248f1c668c988478. 2023-09-14 07:02:23,004 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 4b90ab8ea97d0359248f1c668c988478: 2023-09-14 07:02:23,006 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-14 07:02:23,006 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1694674942978.c03b1e23cf4b29999a350af121c34f62.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694674943006"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694674943006"}]},"ts":"1694674943006"} 2023-09-14 07:02:23,006 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1694674942978.4b90ab8ea97d0359248f1c668c988478.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694674943006"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694674943006"}]},"ts":"1694674943006"} 2023-09-14 07:02:23,008 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-14 07:02:23,009 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-14 07:02:23,009 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694674943009"}]},"ts":"1694674943009"} 2023-09-14 07:02:23,010 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-09-14 07:02:23,014 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-14 07:02:23,015 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-14 07:02:23,015 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-14 07:02:23,015 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-14 07:02:23,015 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-14 07:02:23,015 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4b90ab8ea97d0359248f1c668c988478, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c03b1e23cf4b29999a350af121c34f62, ASSIGN}] 2023-09-14 07:02:23,018 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c03b1e23cf4b29999a350af121c34f62, ASSIGN 2023-09-14 07:02:23,018 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4b90ab8ea97d0359248f1c668c988478, ASSIGN 2023-09-14 07:02:23,018 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c03b1e23cf4b29999a350af121c34f62, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41005,1694674856735; forceNewPlan=false, retain=false 2023-09-14 07:02:23,018 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4b90ab8ea97d0359248f1c668c988478, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35941,1694674856649; forceNewPlan=false, retain=false 2023-09-14 07:02:23,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-14 07:02:23,169 INFO [jenkins-hbase4:33055] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-14 07:02:23,171 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=4b90ab8ea97d0359248f1c668c988478, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:23,171 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=c03b1e23cf4b29999a350af121c34f62, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:23,172 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1694674942978.4b90ab8ea97d0359248f1c668c988478.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694674943171"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694674943171"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694674943171"}]},"ts":"1694674943171"} 2023-09-14 07:02:23,172 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1694674942978.c03b1e23cf4b29999a350af121c34f62.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694674943171"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694674943171"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694674943171"}]},"ts":"1694674943171"} 2023-09-14 07:02:23,173 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 4b90ab8ea97d0359248f1c668c988478, server=jenkins-hbase4.apache.org,35941,1694674856649}] 2023-09-14 07:02:23,174 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure c03b1e23cf4b29999a350af121c34f62, server=jenkins-hbase4.apache.org,41005,1694674856735}] 2023-09-14 07:02:23,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-14 07:02:23,331 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1694674942978.4b90ab8ea97d0359248f1c668c988478. 2023-09-14 07:02:23,331 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1694674942978.c03b1e23cf4b29999a350af121c34f62. 2023-09-14 07:02:23,331 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4b90ab8ea97d0359248f1c668c988478, NAME => 'testtb-testEmptyExportFileSystemState,,1694674942978.4b90ab8ea97d0359248f1c668c988478.', STARTKEY => '', ENDKEY => '1'} 2023-09-14 07:02:23,331 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c03b1e23cf4b29999a350af121c34f62, NAME => 'testtb-testEmptyExportFileSystemState,1,1694674942978.c03b1e23cf4b29999a350af121c34f62.', STARTKEY => '1', ENDKEY => ''} 2023-09-14 07:02:23,331 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1694674942978.4b90ab8ea97d0359248f1c668c988478. service=AccessControlService 2023-09-14 07:02:23,331 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1694674942978.c03b1e23cf4b29999a350af121c34f62. service=AccessControlService 2023-09-14 07:02:23,331 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-14 07:02:23,331 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-14 07:02:23,331 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 4b90ab8ea97d0359248f1c668c988478 2023-09-14 07:02:23,331 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState c03b1e23cf4b29999a350af121c34f62 2023-09-14 07:02:23,331 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1694674942978.4b90ab8ea97d0359248f1c668c988478.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 07:02:23,331 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1694674942978.c03b1e23cf4b29999a350af121c34f62.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 07:02:23,331 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4b90ab8ea97d0359248f1c668c988478 2023-09-14 07:02:23,331 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c03b1e23cf4b29999a350af121c34f62 2023-09-14 07:02:23,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c03b1e23cf4b29999a350af121c34f62 2023-09-14 07:02:23,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4b90ab8ea97d0359248f1c668c988478 2023-09-14 07:02:23,333 INFO [StoreOpener-c03b1e23cf4b29999a350af121c34f62-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c03b1e23cf4b29999a350af121c34f62 2023-09-14 07:02:23,333 INFO [StoreOpener-4b90ab8ea97d0359248f1c668c988478-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4b90ab8ea97d0359248f1c668c988478 2023-09-14 07:02:23,334 DEBUG [StoreOpener-c03b1e23cf4b29999a350af121c34f62-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testEmptyExportFileSystemState/c03b1e23cf4b29999a350af121c34f62/cf 2023-09-14 07:02:23,334 DEBUG [StoreOpener-c03b1e23cf4b29999a350af121c34f62-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testEmptyExportFileSystemState/c03b1e23cf4b29999a350af121c34f62/cf 2023-09-14 07:02:23,334 DEBUG [StoreOpener-4b90ab8ea97d0359248f1c668c988478-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testEmptyExportFileSystemState/4b90ab8ea97d0359248f1c668c988478/cf 2023-09-14 07:02:23,334 DEBUG [StoreOpener-4b90ab8ea97d0359248f1c668c988478-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testEmptyExportFileSystemState/4b90ab8ea97d0359248f1c668c988478/cf 2023-09-14 07:02:23,334 INFO [StoreOpener-c03b1e23cf4b29999a350af121c34f62-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c03b1e23cf4b29999a350af121c34f62 columnFamilyName cf 2023-09-14 07:02:23,334 INFO [StoreOpener-4b90ab8ea97d0359248f1c668c988478-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4b90ab8ea97d0359248f1c668c988478 columnFamilyName cf 2023-09-14 07:02:23,336 INFO [StoreOpener-c03b1e23cf4b29999a350af121c34f62-1] regionserver.HStore(310): Store=c03b1e23cf4b29999a350af121c34f62/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-14 07:02:23,336 INFO [StoreOpener-4b90ab8ea97d0359248f1c668c988478-1] regionserver.HStore(310): Store=4b90ab8ea97d0359248f1c668c988478/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-14 07:02:23,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testEmptyExportFileSystemState/4b90ab8ea97d0359248f1c668c988478 2023-09-14 07:02:23,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testEmptyExportFileSystemState/c03b1e23cf4b29999a350af121c34f62 2023-09-14 07:02:23,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testEmptyExportFileSystemState/4b90ab8ea97d0359248f1c668c988478 2023-09-14 07:02:23,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testEmptyExportFileSystemState/c03b1e23cf4b29999a350af121c34f62 2023-09-14 07:02:23,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4b90ab8ea97d0359248f1c668c988478 2023-09-14 07:02:23,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c03b1e23cf4b29999a350af121c34f62 2023-09-14 07:02:23,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testEmptyExportFileSystemState/4b90ab8ea97d0359248f1c668c988478/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-14 07:02:23,342 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4b90ab8ea97d0359248f1c668c988478; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67831763, jitterRate=0.010772034525871277}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-14 07:02:23,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4b90ab8ea97d0359248f1c668c988478: 2023-09-14 07:02:23,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testEmptyExportFileSystemState/c03b1e23cf4b29999a350af121c34f62/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-14 07:02:23,342 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c03b1e23cf4b29999a350af121c34f62; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73240932, jitterRate=0.09137493371963501}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-14 07:02:23,342 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1694674942978.4b90ab8ea97d0359248f1c668c988478., pid=93, masterSystemTime=1694674943325 2023-09-14 07:02:23,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c03b1e23cf4b29999a350af121c34f62: 2023-09-14 07:02:23,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1694674942978.4b90ab8ea97d0359248f1c668c988478. 2023-09-14 07:02:23,344 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1694674942978.4b90ab8ea97d0359248f1c668c988478. 2023-09-14 07:02:23,344 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=4b90ab8ea97d0359248f1c668c988478, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:23,344 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1694674942978.4b90ab8ea97d0359248f1c668c988478.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694674943344"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694674943344"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694674943344"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694674943344"}]},"ts":"1694674943344"} 2023-09-14 07:02:23,345 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1694674942978.c03b1e23cf4b29999a350af121c34f62., pid=94, masterSystemTime=1694674943325 2023-09-14 07:02:23,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1694674942978.c03b1e23cf4b29999a350af121c34f62. 2023-09-14 07:02:23,346 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1694674942978.c03b1e23cf4b29999a350af121c34f62. 2023-09-14 07:02:23,346 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=c03b1e23cf4b29999a350af121c34f62, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:23,346 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1694674942978.c03b1e23cf4b29999a350af121c34f62.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694674943346"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694674943346"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694674943346"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694674943346"}]},"ts":"1694674943346"} 2023-09-14 07:02:23,347 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=91 2023-09-14 07:02:23,347 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 4b90ab8ea97d0359248f1c668c988478, server=jenkins-hbase4.apache.org,35941,1694674856649 in 173 msec 2023-09-14 07:02:23,348 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4b90ab8ea97d0359248f1c668c988478, ASSIGN in 332 msec 2023-09-14 07:02:23,349 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=92 2023-09-14 07:02:23,349 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure c03b1e23cf4b29999a350af121c34f62, server=jenkins-hbase4.apache.org,41005,1694674856735 in 174 msec 2023-09-14 07:02:23,350 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=92, resume processing ppid=90 2023-09-14 07:02:23,350 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c03b1e23cf4b29999a350af121c34f62, ASSIGN in 334 msec 2023-09-14 07:02:23,351 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-14 07:02:23,351 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694674943351"}]},"ts":"1694674943351"} 2023-09-14 07:02:23,352 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-09-14 07:02:23,355 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-14 07:02:23,355 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-09-14 07:02:23,357 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35941] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-14 07:02:23,359 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 07:02:23,359 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 07:02:23,359 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 07:02:23,359 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 07:02:23,362 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-14 07:02:23,362 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-14 07:02:23,362 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-14 07:02:23,362 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-14 07:02:23,363 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 383 msec 2023-09-14 07:02:23,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-14 07:02:23,587 INFO [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-09-14 07:02:23,589 DEBUG [Listener at jenkins-hbase4.apache.org/40843] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-14 07:02:23,589 DEBUG [Listener at jenkins-hbase4.apache.org/40843] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1694674942978.4b90ab8ea97d0359248f1c668c988478. 2023-09-14 07:02:23,591 INFO [Listener at jenkins-hbase4.apache.org/40843] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-14 07:02:23,601 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-14 07:02:23,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694674943601 (current time:1694674943601). 2023-09-14 07:02:23,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-14 07:02:23,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] zookeeper.ReadOnlyZKClient(139): Connect 0x4b6e4517 to 127.0.0.1:52295 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 07:02:23,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b09001c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 07:02:23,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 07:02:23,619 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39546, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 07:02:23,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4b6e4517 to 127.0.0.1:52295 2023-09-14 07:02:23,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 07:02:23,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] zookeeper.ReadOnlyZKClient(139): Connect 0x7a57f735 to 127.0.0.1:52295 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 07:02:23,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@43a85395, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 07:02:23,627 DEBUG [hconnection-0x20c2b21c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 07:02:23,629 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39556, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 07:02:23,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 07:02:23,635 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42414, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 07:02:23,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7a57f735 to 127.0.0.1:52295 2023-09-14 07:02:23,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 07:02:23,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-14 07:02:23,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-14 07:02:23,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-14 07:02:23,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-14 07:02:23,640 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-14 07:02:23,640 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1694675543640 2023-09-14 07:02:23,640 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-14 07:02:23,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-14 07:02:23,641 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-14 07:02:23,642 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-14 07:02:23,642 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-14 07:02:23,642 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-14 07:02:23,643 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-09-14 07:02:23,646 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-14 07:02:23,647 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1694675543647 2023-09-14 07:02:23,655 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,655 INFO [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-09-14 07:02:23,655 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 07:02:23,656 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-14 07:02:23,656 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-14 07:02:23,656 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,656 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,665 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:02:23,665 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:23,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:02:23,665 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:02:23,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:02:23,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:02:23,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:02:23,665 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:02:23,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:02:23,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:02:23,665 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:23,665 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:23,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,665 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:23,665 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,665 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,665 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-14 07:02:23,666 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-14 07:02:23,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-14 07:02:23,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-14 07:02:23,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,666 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-14 07:02:23,666 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-14 07:02:23,666 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-14 07:02:23,666 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,666 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,666 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-14 07:02:23,666 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-14 07:02:23,666 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,666 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 07:02:23,667 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-14 07:02:23,668 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 07:02:23,666 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 07:02:23,669 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-14 07:02:23,668 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-14 07:02:23,670 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-14 07:02:23,669 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-14 07:02:23,669 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-14 07:02:23,670 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35941,1694674856649' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-14 07:02:23,670 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41005,1694674856735' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-14 07:02:23,670 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-14 07:02:23,670 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37703,1694674856695' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-14 07:02:23,672 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,672 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,672 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 07:02:23,679 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,679 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:23,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:23,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:02:23,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:02:23,681 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,681 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 07:02:23,681 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:23,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:02:23,681 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:02:23,681 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,681 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 07:02:23,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:23,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:23,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:23,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:02:23,683 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35941,1694674856649' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-14 07:02:23,683 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ebc1f46[Count = 1] remaining members to acquire global barrier 2023-09-14 07:02:23,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:23,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:02:23,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:02:23,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:02:23,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:02:23,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:23,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:23,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:23,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:02:23,685 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41005,1694674856735' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-14 07:02:23,685 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ebc1f46[Count = 0] remaining members to acquire global barrier 2023-09-14 07:02:23,685 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-14 07:02:23,685 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,686 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,686 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,686 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,686 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:23,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,686 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-14 07:02:23,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,687 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-14 07:02:23,687 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-14 07:02:23,687 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-14 07:02:23,687 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-14 07:02:23,687 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:23,687 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-14 07:02:23,687 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-14 07:02:23,687 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1694674942978.c03b1e23cf4b29999a350af121c34f62. 2023-09-14 07:02:23,687 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37703,1694674856695' in zk 2023-09-14 07:02:23,687 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1694674942978.c03b1e23cf4b29999a350af121c34f62. started... 2023-09-14 07:02:23,688 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-14 07:02:23,688 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 07:02:23,688 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-14 07:02:23,689 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-14 07:02:23,690 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c03b1e23cf4b29999a350af121c34f62: 2023-09-14 07:02:23,690 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1694674942978.4b90ab8ea97d0359248f1c668c988478. 2023-09-14 07:02:23,690 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-14 07:02:23,690 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1694674942978.4b90ab8ea97d0359248f1c668c988478. started... 2023-09-14 07:02:23,690 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1694674942978.c03b1e23cf4b29999a350af121c34f62.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,690 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-14 07:02:23,690 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-14 07:02:23,690 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4b90ab8ea97d0359248f1c668c988478: 2023-09-14 07:02:23,691 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1694674942978.4b90ab8ea97d0359248f1c668c988478.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,691 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-14 07:02:23,691 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-14 07:02:23,698 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1694674942978.4b90ab8ea97d0359248f1c668c988478. completed. 2023-09-14 07:02:23,698 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1694674942978.c03b1e23cf4b29999a350af121c34f62. completed. 2023-09-14 07:02:23,698 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1694674942978.c03b1e23cf4b29999a350af121c34f62. 2023-09-14 07:02:23,698 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1694674942978.4b90ab8ea97d0359248f1c668c988478. 2023-09-14 07:02:23,698 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-14 07:02:23,698 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-14 07:02:23,698 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:23,698 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-14 07:02:23,698 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-14 07:02:23,698 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41005,1694674856735' in zk 2023-09-14 07:02:23,698 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-14 07:02:23,698 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:23,698 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-14 07:02:23,698 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35941,1694674856649' in zk 2023-09-14 07:02:23,700 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-14 07:02:23,700 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:23,700 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 07:02:23,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:23,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:02:23,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:02:23,700 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-14 07:02:23,704 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:23,704 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-14 07:02:23,704 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 07:02:23,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:02:23,704 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-14 07:02:23,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:02:23,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:23,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:23,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:23,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:02:23,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:23,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:23,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:23,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,41005,1694674856735': 2023-09-14 07:02:23,708 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41005,1694674856735' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-14 07:02:23,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:23,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:02:23,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:02:23,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:02:23,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:02:23,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:23,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:23,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:23,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:02:23,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:23,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:23,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:23,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,35941,1694674856649': 2023-09-14 07:02:23,710 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35941,1694674856649' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-14 07:02:23,710 INFO [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-09-14 07:02:23,710 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-14 07:02:23,710 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-14 07:02:23,710 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,710 INFO [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-14 07:02:23,712 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,712 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:02:23,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:02:23,712 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,712 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:02:23,712 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,712 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:02:23,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,712 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:02:23,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:02:23,712 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:23,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:02:23,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:02:23,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:02:23,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:02:23,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:02:23,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:02:23,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,713 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:23,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:02:23,713 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:23,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:23,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:23,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:23,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:02:23,715 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:23,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,715 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:23,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:23,715 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:23,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:23,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:23,718 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:23,718 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,718 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:02:23,718 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:02:23,718 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:02:23,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:02:23,718 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:23,718 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:02:23,718 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:23,718 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:02:23,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:02:23,718 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,718 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 07:02:23,718 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:02:23,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:02:23,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:02:23,718 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-14 07:02:23,718 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:02:23,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:02:23,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:02:23,720 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:23,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:02:23,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:02:23,720 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,720 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:02:23,720 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:23,720 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-14 07:02:23,720 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:23,720 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,720 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:02:23,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:02:23,721 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-14 07:02:23,729 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,729 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,742 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-14 07:02:23,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-14 07:02:23,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-14 07:02:23,743 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-14 07:02:23,744 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,745 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-14 07:02:23,745 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,745 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:23,745 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1694674943640Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1694674943729 (+89 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1694674943729Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1694674943729Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1694674943732 (+3 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1694674943739 (+7 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1694674943745 (+6 ms) 2023-09-14 07:02:23,748 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-14 07:02:23,750 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 107 msec 2023-09-14 07:02:23,943 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-14 07:02:23,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-14 07:02:23,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-14 07:02:23,946 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35941] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1694674942978.4b90ab8ea97d0359248f1c668c988478. with WAL disabled. Data may be lost in the event of a crash. 2023-09-14 07:02:23,948 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41005] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1694674942978.c03b1e23cf4b29999a350af121c34f62. with WAL disabled. Data may be lost in the event of a crash. 2023-09-14 07:02:23,951 DEBUG [Listener at jenkins-hbase4.apache.org/40843] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-14 07:02:23,951 DEBUG [Listener at jenkins-hbase4.apache.org/40843] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1694674942978.4b90ab8ea97d0359248f1c668c988478. 2023-09-14 07:02:23,951 INFO [Listener at jenkins-hbase4.apache.org/40843] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-14 07:02:23,960 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-14 07:02:23,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694674943961 (current time:1694674943961). 2023-09-14 07:02:23,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-14 07:02:23,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] zookeeper.ReadOnlyZKClient(139): Connect 0x2d64f9cc to 127.0.0.1:52295 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 07:02:23,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1803fc2e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 07:02:23,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 07:02:23,971 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39566, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 07:02:23,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2d64f9cc to 127.0.0.1:52295 2023-09-14 07:02:23,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 07:02:23,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] zookeeper.ReadOnlyZKClient(139): Connect 0x0052b6c8 to 127.0.0.1:52295 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 07:02:23,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@af28597, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 07:02:23,979 DEBUG [hconnection-0xd17ea6b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 07:02:23,980 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39572, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 07:02:23,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 07:02:23,985 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42420, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 07:02:23,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0052b6c8 to 127.0.0.1:52295 2023-09-14 07:02:23,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 07:02:23,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-14 07:02:23,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-14 07:02:23,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-14 07:02:23,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-14 07:02:23,990 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-14 07:02:23,991 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1694675543991 2023-09-14 07:02:23,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-14 07:02:23,991 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-14 07:02:23,993 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-14 07:02:23,993 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-14 07:02:23,994 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-14 07:02:23,994 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-14 07:02:23,995 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-09-14 07:02:23,996 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-14 07:02:23,997 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1694675543997 2023-09-14 07:02:24,006 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,006 INFO [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-09-14 07:02:24,006 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 07:02:24,008 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-14 07:02:24,008 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-14 07:02:24,008 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,008 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,010 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:24,010 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:02:24,010 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:02:24,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:02:24,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:02:24,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:02:24,010 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:02:24,010 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:24,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:02:24,010 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:24,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:02:24,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:02:24,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,010 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:24,010 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-14 07:02:24,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,011 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,011 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,011 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-14 07:02:24,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,011 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-14 07:02:24,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-14 07:02:24,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-14 07:02:24,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,011 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,011 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-14 07:02:24,011 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-14 07:02:24,012 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 07:02:24,011 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-14 07:02:24,013 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-14 07:02:24,013 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,013 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,013 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-14 07:02:24,013 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 07:02:24,013 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-14 07:02:24,014 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-14 07:02:24,014 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37703,1694674856695' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-14 07:02:24,013 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-14 07:02:24,014 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-14 07:02:24,014 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 07:02:24,014 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35941,1694674856649' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-14 07:02:24,017 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-14 07:02:24,017 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-14 07:02:24,017 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41005,1694674856735' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-14 07:02:24,020 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,020 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:24,020 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:24,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:02:24,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:02:24,021 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:24,021 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,021 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,021 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 07:02:24,021 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,021 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 07:02:24,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:02:24,021 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:02:24,021 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 07:02:24,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:24,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:24,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:24,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:02:24,023 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35941,1694674856649' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-14 07:02:24,023 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a25e488[Count = 1] remaining members to acquire global barrier 2023-09-14 07:02:24,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:24,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:02:24,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:02:24,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:02:24,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:02:24,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:24,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:24,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:24,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:02:24,024 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41005,1694674856735' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-14 07:02:24,025 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a25e488[Count = 0] remaining members to acquire global barrier 2023-09-14 07:02:24,025 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-14 07:02:24,025 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,028 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,028 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,028 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,028 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-14 07:02:24,028 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-14 07:02:24,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,028 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37703,1694674856695' in zk 2023-09-14 07:02:24,028 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-14 07:02:24,028 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:24,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,029 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-14 07:02:24,029 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-14 07:02:24,029 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1694674942978.c03b1e23cf4b29999a350af121c34f62. 2023-09-14 07:02:24,029 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-14 07:02:24,029 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1694674942978.c03b1e23cf4b29999a350af121c34f62. started... 2023-09-14 07:02:24,029 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:24,029 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-14 07:02:24,029 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-14 07:02:24,029 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1694674942978.4b90ab8ea97d0359248f1c668c988478. 2023-09-14 07:02:24,029 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-14 07:02:24,029 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1694674942978.4b90ab8ea97d0359248f1c668c988478. started... 2023-09-14 07:02:24,029 INFO [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c03b1e23cf4b29999a350af121c34f62 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-09-14 07:02:24,029 INFO [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4b90ab8ea97d0359248f1c668c988478 1/1 column families, dataSize=132 B heapSize=544 B 2023-09-14 07:02:24,030 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-14 07:02:24,030 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 07:02:24,030 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-14 07:02:24,053 INFO [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230914efbddf48943a4efab9f500572f442913 to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230914efbddf48943a4efab9f500572f442913 2023-09-14 07:02:24,054 INFO [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309148e18a1d3173d46eb88f34bd31da524c1 to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309148e18a1d3173d46eb88f34bd31da524c1 2023-09-14 07:02:24,065 INFO [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testEmptyExportFileSystemState/4b90ab8ea97d0359248f1c668c988478/.tmp/cf/67f8feddd6be42f48a92b528de9af301 2023-09-14 07:02:24,065 INFO [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testEmptyExportFileSystemState/c03b1e23cf4b29999a350af121c34f62/.tmp/cf/e4267c98990c4351ab2381026aed8048 2023-09-14 07:02:24,070 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testEmptyExportFileSystemState/4b90ab8ea97d0359248f1c668c988478/.tmp/cf/67f8feddd6be42f48a92b528de9af301 as hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testEmptyExportFileSystemState/4b90ab8ea97d0359248f1c668c988478/cf/67f8feddd6be42f48a92b528de9af301 2023-09-14 07:02:24,070 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testEmptyExportFileSystemState/c03b1e23cf4b29999a350af121c34f62/.tmp/cf/e4267c98990c4351ab2381026aed8048 as hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testEmptyExportFileSystemState/c03b1e23cf4b29999a350af121c34f62/cf/e4267c98990c4351ab2381026aed8048 2023-09-14 07:02:24,075 INFO [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testEmptyExportFileSystemState/4b90ab8ea97d0359248f1c668c988478/cf/67f8feddd6be42f48a92b528de9af301, entries=2, sequenceid=6, filesize=5.2 K 2023-09-14 07:02:24,075 INFO [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testEmptyExportFileSystemState/c03b1e23cf4b29999a350af121c34f62/cf/e4267c98990c4351ab2381026aed8048, entries=48, sequenceid=6, filesize=13.2 K 2023-09-14 07:02:24,078 INFO [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 4b90ab8ea97d0359248f1c668c988478 in 49ms, sequenceid=6, compaction requested=false 2023-09-14 07:02:24,078 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-14 07:02:24,078 INFO [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for c03b1e23cf4b29999a350af121c34f62 in 49ms, sequenceid=6, compaction requested=false 2023-09-14 07:02:24,078 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-14 07:02:24,081 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4b90ab8ea97d0359248f1c668c988478: 2023-09-14 07:02:24,081 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c03b1e23cf4b29999a350af121c34f62: 2023-09-14 07:02:24,081 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1694674942978.4b90ab8ea97d0359248f1c668c988478.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,081 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1694674942978.c03b1e23cf4b29999a350af121c34f62.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,081 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-14 07:02:24,082 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-14 07:02:24,082 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testEmptyExportFileSystemState/4b90ab8ea97d0359248f1c668c988478/cf/67f8feddd6be42f48a92b528de9af301] hfiles 2023-09-14 07:02:24,082 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testEmptyExportFileSystemState/c03b1e23cf4b29999a350af121c34f62/cf/e4267c98990c4351ab2381026aed8048] hfiles 2023-09-14 07:02:24,082 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testEmptyExportFileSystemState/c03b1e23cf4b29999a350af121c34f62/cf/e4267c98990c4351ab2381026aed8048 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,082 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testEmptyExportFileSystemState/4b90ab8ea97d0359248f1c668c988478/cf/67f8feddd6be42f48a92b528de9af301 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,093 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-14 07:02:24,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-14 07:02:24,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-14 07:02:24,095 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-14 07:02:24,096 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1694674942978.c03b1e23cf4b29999a350af121c34f62. completed. 2023-09-14 07:02:24,096 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1694674942978.4b90ab8ea97d0359248f1c668c988478. completed. 2023-09-14 07:02:24,096 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1694674942978.4b90ab8ea97d0359248f1c668c988478. 2023-09-14 07:02:24,096 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1694674942978.c03b1e23cf4b29999a350af121c34f62. 2023-09-14 07:02:24,096 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-14 07:02:24,096 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-14 07:02:24,096 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-14 07:02:24,096 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:24,096 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-14 07:02:24,096 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-14 07:02:24,096 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:24,096 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41005,1694674856735' in zk 2023-09-14 07:02:24,096 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-14 07:02:24,096 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35941,1694674856649' in zk 2023-09-14 07:02:24,098 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:24,098 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-14 07:02:24,098 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:24,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:24,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:02:24,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:02:24,098 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 07:02:24,098 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-14 07:02:24,098 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-14 07:02:24,100 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 07:02:24,100 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-14 07:02:24,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:02:24,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:02:24,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:24,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:24,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:24,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:02:24,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:24,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:24,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:24,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,35941,1694674856649': 2023-09-14 07:02:24,104 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35941,1694674856649' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-14 07:02:24,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:24,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:02:24,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:02:24,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:02:24,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:02:24,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:24,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:24,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:24,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:02:24,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:24,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:24,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:24,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,41005,1694674856735': 2023-09-14 07:02:24,107 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41005,1694674856735' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-14 07:02:24,107 INFO [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-09-14 07:02:24,107 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-14 07:02:24,107 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-14 07:02:24,107 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,107 INFO [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-14 07:02:24,110 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,110 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:02:24,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,110 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,110 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,111 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:02:24,111 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:02:24,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,111 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:02:24,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:02:24,111 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:24,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:02:24,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:02:24,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:02:24,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:02:24,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:02:24,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:02:24,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:02:24,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,112 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:24,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,112 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:24,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:02:24,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:24,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:24,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:24,114 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:24,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:02:24,114 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:24,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,114 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:24,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:24,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:24,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:24,117 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:24,117 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,117 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:24,117 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:24,117 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:02:24,117 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:02:24,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:02:24,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:02:24,117 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,117 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:02:24,117 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:02:24,117 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:02:24,117 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:24,117 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:02:24,117 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-14 07:02:24,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:02:24,117 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,117 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 07:02:24,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:02:24,117 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:02:24,118 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-14 07:02:24,117 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:02:24,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:02:24,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:02:24,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:02:24,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:02:24,119 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:24,119 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:24,120 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,120 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:02:24,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:02:24,120 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309148e18a1d3173d46eb88f34bd31da524c1, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230914efbddf48943a4efab9f500572f442913] mob files 2023-09-14 07:02:24,120 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309148e18a1d3173d46eb88f34bd31da524c1 2023-09-14 07:02:24,120 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230914efbddf48943a4efab9f500572f442913 2023-09-14 07:02:24,131 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,132 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,152 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,153 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-14 07:02:24,153 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,153 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,153 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1694674943991Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1694674944131 (+140 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1694674944131Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1694674944131Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1694674944138 (+7 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1694674944146 (+8 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1694674944153 (+7 ms) 2023-09-14 07:02:24,156 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-14 07:02:24,157 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 163 msec 2023-09-14 07:02:24,295 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-14 07:02:24,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-14 07:02:24,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-14 07:02:24,297 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/export-test/export-1694674944297 2023-09-14 07:02:24,297 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44283, tgtDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/export-test/export-1694674944297, rawTgtDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/export-test/export-1694674944297, srcFsUri=hdfs://localhost:44283, srcDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04 2023-09-14 07:02:24,318 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44283, inputRoot=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04 2023-09-14 07:02:24,319 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1346965172_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/export-test/export-1694674944297, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/export-test/export-1694674944297/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,319 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44283, inputRoot=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04, snapshotDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-09-14 07:02:24,324 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/export-test/export-1694674944297/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:24,348 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-14 07:02:24,348 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-14 07:02:24,349 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-14 07:02:24,349 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-14 07:02:25,221 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/hadoop-9087925732706725542.jar 2023-09-14 07:02:25,222 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-14 07:02:25,222 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-14 07:02:25,288 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/hadoop-3073420397666153964.jar 2023-09-14 07:02:25,289 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-14 07:02:25,289 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-14 07:02:25,289 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-14 07:02:25,290 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-14 07:02:25,290 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-14 07:02:25,290 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-14 07:02:25,291 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-14 07:02:25,291 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-14 07:02:25,291 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-14 07:02:25,292 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-14 07:02:25,292 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-14 07:02:25,292 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-14 07:02:25,293 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-14 07:02:25,293 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-14 07:02:25,293 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-14 07:02:25,294 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-14 07:02:25,294 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 07:02:25,295 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 07:02:25,295 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-14 07:02:25,295 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 07:02:25,296 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 07:02:25,296 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-14 07:02:25,297 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-14 07:02:25,652 WARN [Listener at jenkins-hbase4.apache.org/40843] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-14 07:02:25,654 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-09-14 07:02:26,872 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-14 07:02:26,872 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-14 07:02:26,879 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694674863103_0005_000001 (auth:SIMPLE) 2023-09-14 07:02:27,829 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-14 07:02:27,851 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694674863103_0006_000001 (auth:SIMPLE) 2023-09-14 07:02:31,615 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694674863103_0006_000001 (auth:SIMPLE) 2023-09-14 07:02:33,983 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-14 07:02:33,984 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-14 07:02:33,989 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:33,989 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-14 07:02:33,989 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-14 07:02:33,989 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_409472800_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:33,990 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(367): hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-14 07:02:33,990 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(367): hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-14 07:02:33,990 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_409472800_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/export-test/export-1694674944297/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/export-test/export-1694674944297/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:33,990 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(367): hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/export-test/export-1694674944297/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-14 07:02:33,990 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(367): hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/export-test/export-1694674944297/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-14 07:02:33,996 INFO [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-09-14 07:02:33,996 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-09-14 07:02:33,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-14 07:02:34,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-14 07:02:34,001 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694674954000"}]},"ts":"1694674954000"} 2023-09-14 07:02:34,002 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-09-14 07:02:34,004 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-09-14 07:02:34,004 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4b90ab8ea97d0359248f1c668c988478, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c03b1e23cf4b29999a350af121c34f62, UNASSIGN}] 2023-09-14 07:02:34,010 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4b90ab8ea97d0359248f1c668c988478, UNASSIGN 2023-09-14 07:02:34,010 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c03b1e23cf4b29999a350af121c34f62, UNASSIGN 2023-09-14 07:02:34,011 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=c03b1e23cf4b29999a350af121c34f62, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:34,011 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=4b90ab8ea97d0359248f1c668c988478, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:34,011 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1694674942978.c03b1e23cf4b29999a350af121c34f62.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694674954011"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694674954011"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694674954011"}]},"ts":"1694674954011"} 2023-09-14 07:02:34,011 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1694674942978.4b90ab8ea97d0359248f1c668c988478.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694674954011"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694674954011"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694674954011"}]},"ts":"1694674954011"} 2023-09-14 07:02:34,012 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure c03b1e23cf4b29999a350af121c34f62, server=jenkins-hbase4.apache.org,41005,1694674856735}] 2023-09-14 07:02:34,014 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure 4b90ab8ea97d0359248f1c668c988478, server=jenkins-hbase4.apache.org,35941,1694674856649}] 2023-09-14 07:02:34,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-14 07:02:34,165 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c03b1e23cf4b29999a350af121c34f62 2023-09-14 07:02:34,165 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4b90ab8ea97d0359248f1c668c988478 2023-09-14 07:02:34,165 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c03b1e23cf4b29999a350af121c34f62, disabling compactions & flushes 2023-09-14 07:02:34,165 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4b90ab8ea97d0359248f1c668c988478, disabling compactions & flushes 2023-09-14 07:02:34,165 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1694674942978.c03b1e23cf4b29999a350af121c34f62. 2023-09-14 07:02:34,165 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1694674942978.4b90ab8ea97d0359248f1c668c988478. 2023-09-14 07:02:34,166 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1694674942978.c03b1e23cf4b29999a350af121c34f62. 2023-09-14 07:02:34,166 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1694674942978.4b90ab8ea97d0359248f1c668c988478. 2023-09-14 07:02:34,166 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1694674942978.c03b1e23cf4b29999a350af121c34f62. after waiting 0 ms 2023-09-14 07:02:34,166 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1694674942978.c03b1e23cf4b29999a350af121c34f62. 2023-09-14 07:02:34,166 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1694674942978.4b90ab8ea97d0359248f1c668c988478. after waiting 0 ms 2023-09-14 07:02:34,166 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1694674942978.4b90ab8ea97d0359248f1c668c988478. 2023-09-14 07:02:34,174 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testEmptyExportFileSystemState/c03b1e23cf4b29999a350af121c34f62/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-14 07:02:34,174 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testEmptyExportFileSystemState/4b90ab8ea97d0359248f1c668c988478/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-14 07:02:34,174 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-14 07:02:34,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-14 07:02:34,175 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1694674942978.c03b1e23cf4b29999a350af121c34f62. 2023-09-14 07:02:34,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c03b1e23cf4b29999a350af121c34f62: 2023-09-14 07:02:34,176 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1694674942978.4b90ab8ea97d0359248f1c668c988478. 2023-09-14 07:02:34,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4b90ab8ea97d0359248f1c668c988478: 2023-09-14 07:02:34,178 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c03b1e23cf4b29999a350af121c34f62 2023-09-14 07:02:34,178 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=c03b1e23cf4b29999a350af121c34f62, regionState=CLOSED 2023-09-14 07:02:34,178 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1694674942978.c03b1e23cf4b29999a350af121c34f62.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694674954178"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694674954178"}]},"ts":"1694674954178"} 2023-09-14 07:02:34,178 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4b90ab8ea97d0359248f1c668c988478 2023-09-14 07:02:34,179 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=4b90ab8ea97d0359248f1c668c988478, regionState=CLOSED 2023-09-14 07:02:34,179 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1694674942978.4b90ab8ea97d0359248f1c668c988478.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694674954179"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694674954179"}]},"ts":"1694674954179"} 2023-09-14 07:02:34,182 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=101 2023-09-14 07:02:34,182 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure c03b1e23cf4b29999a350af121c34f62, server=jenkins-hbase4.apache.org,41005,1694674856735 in 168 msec 2023-09-14 07:02:34,182 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=100 2023-09-14 07:02:34,182 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure 4b90ab8ea97d0359248f1c668c988478, server=jenkins-hbase4.apache.org,35941,1694674856649 in 167 msec 2023-09-14 07:02:34,183 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c03b1e23cf4b29999a350af121c34f62, UNASSIGN in 178 msec 2023-09-14 07:02:34,184 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=100, resume processing ppid=99 2023-09-14 07:02:34,184 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4b90ab8ea97d0359248f1c668c988478, UNASSIGN in 178 msec 2023-09-14 07:02:34,185 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694674954185"}]},"ts":"1694674954185"} 2023-09-14 07:02:34,186 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-09-14 07:02:34,188 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-09-14 07:02:34,190 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 193 msec 2023-09-14 07:02:34,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-14 07:02:34,303 INFO [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-09-14 07:02:34,303 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-09-14 07:02:34,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-14 07:02:34,306 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-14 07:02:34,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-09-14 07:02:34,307 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-14 07:02:34,308 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35941] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-09-14 07:02:34,311 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-14 07:02:34,311 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testEmptyExportFileSystemState/c03b1e23cf4b29999a350af121c34f62 2023-09-14 07:02:34,311 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-14 07:02:34,311 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-14 07:02:34,311 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testEmptyExportFileSystemState/4b90ab8ea97d0359248f1c668c988478 2023-09-14 07:02:34,311 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-14 07:02:34,312 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-14 07:02:34,312 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-14 07:02:34,312 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-14 07:02:34,313 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-14 07:02:34,313 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-14 07:02:34,313 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 07:02:34,313 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-14 07:02:34,313 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-09-14 07:02:34,313 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 07:02:34,313 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 07:02:34,313 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-14 07:02:34,313 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 07:02:34,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-14 07:02:34,314 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testEmptyExportFileSystemState/c03b1e23cf4b29999a350af121c34f62/cf, FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testEmptyExportFileSystemState/c03b1e23cf4b29999a350af121c34f62/recovered.edits] 2023-09-14 07:02:34,314 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testEmptyExportFileSystemState/4b90ab8ea97d0359248f1c668c988478/cf, FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testEmptyExportFileSystemState/4b90ab8ea97d0359248f1c668c988478/recovered.edits] 2023-09-14 07:02:34,318 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testEmptyExportFileSystemState/c03b1e23cf4b29999a350af121c34f62/cf/e4267c98990c4351ab2381026aed8048 to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/archive/data/default/testtb-testEmptyExportFileSystemState/c03b1e23cf4b29999a350af121c34f62/cf/e4267c98990c4351ab2381026aed8048 2023-09-14 07:02:34,318 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testEmptyExportFileSystemState/4b90ab8ea97d0359248f1c668c988478/cf/67f8feddd6be42f48a92b528de9af301 to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/archive/data/default/testtb-testEmptyExportFileSystemState/4b90ab8ea97d0359248f1c668c988478/cf/67f8feddd6be42f48a92b528de9af301 2023-09-14 07:02:34,321 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testEmptyExportFileSystemState/c03b1e23cf4b29999a350af121c34f62/recovered.edits/9.seqid to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/archive/data/default/testtb-testEmptyExportFileSystemState/c03b1e23cf4b29999a350af121c34f62/recovered.edits/9.seqid 2023-09-14 07:02:34,321 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testEmptyExportFileSystemState/4b90ab8ea97d0359248f1c668c988478/recovered.edits/9.seqid to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/archive/data/default/testtb-testEmptyExportFileSystemState/4b90ab8ea97d0359248f1c668c988478/recovered.edits/9.seqid 2023-09-14 07:02:34,322 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testEmptyExportFileSystemState/c03b1e23cf4b29999a350af121c34f62 2023-09-14 07:02:34,322 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testEmptyExportFileSystemState/4b90ab8ea97d0359248f1c668c988478 2023-09-14 07:02:34,322 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-14 07:02:34,322 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-14 07:02:34,323 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-09-14 07:02:34,326 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309148e18a1d3173d46eb88f34bd31da524c1 to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309148e18a1d3173d46eb88f34bd31da524c1 2023-09-14 07:02:34,328 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230914efbddf48943a4efab9f500572f442913 to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230914efbddf48943a4efab9f500572f442913 2023-09-14 07:02:34,328 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-14 07:02:34,330 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-14 07:02:34,332 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-09-14 07:02:34,334 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-09-14 07:02:34,335 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-14 07:02:34,336 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-09-14 07:02:34,336 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1694674942978.4b90ab8ea97d0359248f1c668c988478.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694674954336"}]},"ts":"9223372036854775807"} 2023-09-14 07:02:34,336 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1694674942978.c03b1e23cf4b29999a350af121c34f62.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694674954336"}]},"ts":"9223372036854775807"} 2023-09-14 07:02:34,337 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-14 07:02:34,338 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 4b90ab8ea97d0359248f1c668c988478, NAME => 'testtb-testEmptyExportFileSystemState,,1694674942978.4b90ab8ea97d0359248f1c668c988478.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => c03b1e23cf4b29999a350af121c34f62, NAME => 'testtb-testEmptyExportFileSystemState,1,1694674942978.c03b1e23cf4b29999a350af121c34f62.', STARTKEY => '1', ENDKEY => ''}] 2023-09-14 07:02:34,338 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-09-14 07:02:34,338 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694674954338"}]},"ts":"9223372036854775807"} 2023-09-14 07:02:34,339 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-09-14 07:02:34,341 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-14 07:02:34,342 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 38 msec 2023-09-14 07:02:34,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-14 07:02:34,415 INFO [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-09-14 07:02:34,422 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-09-14 07:02:34,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:34,425 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-09-14 07:02:34,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-09-14 07:02:34,451 INFO [Listener at jenkins-hbase4.apache.org/40843] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=766 (was 759) Potentially hanging thread: IPC Client (698022672) connection to jenkins-hbase4.apache.org/172.31.14.131:46103 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_409472800_17 at /127.0.0.1:42516 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1346965172_17 at /127.0.0.1:56602 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (698022672) connection to jenkins-hbase4.apache.org/172.31.14.131:42261 from appattempt_1694674863103_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3a740ce4-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_409472800_17 at /127.0.0.1:39274 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4608 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x3a740ce4-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-583934472_1 at /127.0.0.1:42478 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (698022672) connection to jenkins-hbase4.apache.org/172.31.14.131:34555 from appattempt_1694674863103_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x3a740ce4-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-583934472_1 at /127.0.0.1:56574 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3a740ce4-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=930 (was 913) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=170 (was 172), ProcessCount=168 (was 168), AvailableMemoryMB=8274 (was 8314) 2023-09-14 07:02:34,451 WARN [Listener at jenkins-hbase4.apache.org/40843] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-14 07:02:34,473 INFO [Listener at jenkins-hbase4.apache.org/40843] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=766, OpenFileDescriptor=930, MaxFileDescriptor=60000, SystemLoadAverage=170, ProcessCount=168, AvailableMemoryMB=8270 2023-09-14 07:02:34,473 WARN [Listener at jenkins-hbase4.apache.org/40843] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-14 07:02:34,475 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-14 07:02:34,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:34,478 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-09-14 07:02:34,478 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-09-14 07:02:34,478 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-14 07:02:34,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-14 07:02:34,481 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fb1077524cd291853d0842c59bd3379c 2023-09-14 07:02:34,481 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e0c3d438b8b930a7d0d5e61112327f8e 2023-09-14 07:02:34,482 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fb1077524cd291853d0842c59bd3379c empty. 2023-09-14 07:02:34,482 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e0c3d438b8b930a7d0d5e61112327f8e empty. 2023-09-14 07:02:34,482 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fb1077524cd291853d0842c59bd3379c 2023-09-14 07:02:34,482 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e0c3d438b8b930a7d0d5e61112327f8e 2023-09-14 07:02:34,482 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-14 07:02:34,491 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-09-14 07:02:34,493 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => fb1077524cd291853d0842c59bd3379c, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1694674954474.fb1077524cd291853d0842c59bd3379c.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp 2023-09-14 07:02:34,493 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => e0c3d438b8b930a7d0d5e61112327f8e, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1694674954474.e0c3d438b8b930a7d0d5e61112327f8e.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp 2023-09-14 07:02:34,512 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1694674954474.e0c3d438b8b930a7d0d5e61112327f8e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 07:02:34,512 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing e0c3d438b8b930a7d0d5e61112327f8e, disabling compactions & flushes 2023-09-14 07:02:34,512 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1694674954474.e0c3d438b8b930a7d0d5e61112327f8e. 2023-09-14 07:02:34,512 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1694674954474.e0c3d438b8b930a7d0d5e61112327f8e. 2023-09-14 07:02:34,512 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1694674954474.e0c3d438b8b930a7d0d5e61112327f8e. after waiting 0 ms 2023-09-14 07:02:34,512 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1694674954474.e0c3d438b8b930a7d0d5e61112327f8e. 2023-09-14 07:02:34,512 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1694674954474.e0c3d438b8b930a7d0d5e61112327f8e. 2023-09-14 07:02:34,512 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for e0c3d438b8b930a7d0d5e61112327f8e: 2023-09-14 07:02:34,512 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1694674954474.fb1077524cd291853d0842c59bd3379c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 07:02:34,512 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing fb1077524cd291853d0842c59bd3379c, disabling compactions & flushes 2023-09-14 07:02:34,512 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1694674954474.fb1077524cd291853d0842c59bd3379c. 2023-09-14 07:02:34,512 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1694674954474.fb1077524cd291853d0842c59bd3379c. 2023-09-14 07:02:34,512 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1694674954474.fb1077524cd291853d0842c59bd3379c. after waiting 0 ms 2023-09-14 07:02:34,512 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1694674954474.fb1077524cd291853d0842c59bd3379c. 2023-09-14 07:02:34,512 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1694674954474.fb1077524cd291853d0842c59bd3379c. 2023-09-14 07:02:34,513 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for fb1077524cd291853d0842c59bd3379c: 2023-09-14 07:02:34,515 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-09-14 07:02:34,516 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694674954474.e0c3d438b8b930a7d0d5e61112327f8e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694674954515"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694674954515"}]},"ts":"1694674954515"} 2023-09-14 07:02:34,516 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694674954474.fb1077524cd291853d0842c59bd3379c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694674954515"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694674954515"}]},"ts":"1694674954515"} 2023-09-14 07:02:34,518 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-14 07:02:34,518 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-14 07:02:34,518 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694674954518"}]},"ts":"1694674954518"} 2023-09-14 07:02:34,520 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-09-14 07:02:34,523 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-14 07:02:34,524 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-14 07:02:34,524 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-14 07:02:34,524 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-14 07:02:34,524 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-14 07:02:34,525 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=fb1077524cd291853d0842c59bd3379c, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e0c3d438b8b930a7d0d5e61112327f8e, ASSIGN}] 2023-09-14 07:02:34,527 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=fb1077524cd291853d0842c59bd3379c, ASSIGN 2023-09-14 07:02:34,527 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e0c3d438b8b930a7d0d5e61112327f8e, ASSIGN 2023-09-14 07:02:34,528 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=fb1077524cd291853d0842c59bd3379c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35941,1694674856649; forceNewPlan=false, retain=false 2023-09-14 07:02:34,528 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e0c3d438b8b930a7d0d5e61112327f8e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41005,1694674856735; forceNewPlan=false, retain=false 2023-09-14 07:02:34,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-14 07:02:34,678 INFO [jenkins-hbase4:33055] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-14 07:02:34,681 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=fb1077524cd291853d0842c59bd3379c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:34,681 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=e0c3d438b8b930a7d0d5e61112327f8e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:34,681 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694674954474.fb1077524cd291853d0842c59bd3379c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694674954681"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694674954681"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694674954681"}]},"ts":"1694674954681"} 2023-09-14 07:02:34,681 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694674954474.e0c3d438b8b930a7d0d5e61112327f8e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694674954681"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694674954681"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694674954681"}]},"ts":"1694674954681"} 2023-09-14 07:02:34,683 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure e0c3d438b8b930a7d0d5e61112327f8e, server=jenkins-hbase4.apache.org,41005,1694674856735}] 2023-09-14 07:02:34,683 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure fb1077524cd291853d0842c59bd3379c, server=jenkins-hbase4.apache.org,35941,1694674856649}] 2023-09-14 07:02:34,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-14 07:02:34,838 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1694674954474.e0c3d438b8b930a7d0d5e61112327f8e. 2023-09-14 07:02:34,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e0c3d438b8b930a7d0d5e61112327f8e, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1694674954474.e0c3d438b8b930a7d0d5e61112327f8e.', STARTKEY => '1', ENDKEY => ''} 2023-09-14 07:02:34,838 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1694674954474.fb1077524cd291853d0842c59bd3379c. 2023-09-14 07:02:34,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1694674954474.e0c3d438b8b930a7d0d5e61112327f8e. service=AccessControlService 2023-09-14 07:02:34,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fb1077524cd291853d0842c59bd3379c, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1694674954474.fb1077524cd291853d0842c59bd3379c.', STARTKEY => '', ENDKEY => '1'} 2023-09-14 07:02:34,838 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-14 07:02:34,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1694674954474.fb1077524cd291853d0842c59bd3379c. service=AccessControlService 2023-09-14 07:02:34,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp e0c3d438b8b930a7d0d5e61112327f8e 2023-09-14 07:02:34,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1694674954474.e0c3d438b8b930a7d0d5e61112327f8e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 07:02:34,839 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-14 07:02:34,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e0c3d438b8b930a7d0d5e61112327f8e 2023-09-14 07:02:34,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e0c3d438b8b930a7d0d5e61112327f8e 2023-09-14 07:02:34,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp fb1077524cd291853d0842c59bd3379c 2023-09-14 07:02:34,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1694674954474.fb1077524cd291853d0842c59bd3379c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 07:02:34,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fb1077524cd291853d0842c59bd3379c 2023-09-14 07:02:34,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fb1077524cd291853d0842c59bd3379c 2023-09-14 07:02:34,840 INFO [StoreOpener-e0c3d438b8b930a7d0d5e61112327f8e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e0c3d438b8b930a7d0d5e61112327f8e 2023-09-14 07:02:34,840 INFO [StoreOpener-fb1077524cd291853d0842c59bd3379c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region fb1077524cd291853d0842c59bd3379c 2023-09-14 07:02:34,841 DEBUG [StoreOpener-e0c3d438b8b930a7d0d5e61112327f8e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithSkipTmp/e0c3d438b8b930a7d0d5e61112327f8e/cf 2023-09-14 07:02:34,841 DEBUG [StoreOpener-fb1077524cd291853d0842c59bd3379c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithSkipTmp/fb1077524cd291853d0842c59bd3379c/cf 2023-09-14 07:02:34,841 DEBUG [StoreOpener-e0c3d438b8b930a7d0d5e61112327f8e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithSkipTmp/e0c3d438b8b930a7d0d5e61112327f8e/cf 2023-09-14 07:02:34,841 DEBUG [StoreOpener-fb1077524cd291853d0842c59bd3379c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithSkipTmp/fb1077524cd291853d0842c59bd3379c/cf 2023-09-14 07:02:34,842 INFO [StoreOpener-fb1077524cd291853d0842c59bd3379c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fb1077524cd291853d0842c59bd3379c columnFamilyName cf 2023-09-14 07:02:34,842 INFO [StoreOpener-e0c3d438b8b930a7d0d5e61112327f8e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e0c3d438b8b930a7d0d5e61112327f8e columnFamilyName cf 2023-09-14 07:02:34,843 INFO [StoreOpener-e0c3d438b8b930a7d0d5e61112327f8e-1] regionserver.HStore(310): Store=e0c3d438b8b930a7d0d5e61112327f8e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-14 07:02:34,843 INFO [StoreOpener-fb1077524cd291853d0842c59bd3379c-1] regionserver.HStore(310): Store=fb1077524cd291853d0842c59bd3379c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-14 07:02:34,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithSkipTmp/e0c3d438b8b930a7d0d5e61112327f8e 2023-09-14 07:02:34,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithSkipTmp/fb1077524cd291853d0842c59bd3379c 2023-09-14 07:02:34,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithSkipTmp/e0c3d438b8b930a7d0d5e61112327f8e 2023-09-14 07:02:34,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithSkipTmp/fb1077524cd291853d0842c59bd3379c 2023-09-14 07:02:34,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e0c3d438b8b930a7d0d5e61112327f8e 2023-09-14 07:02:34,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fb1077524cd291853d0842c59bd3379c 2023-09-14 07:02:34,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithSkipTmp/e0c3d438b8b930a7d0d5e61112327f8e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-14 07:02:34,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithSkipTmp/fb1077524cd291853d0842c59bd3379c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-14 07:02:34,849 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e0c3d438b8b930a7d0d5e61112327f8e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72327465, jitterRate=0.07776321470737457}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-14 07:02:34,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e0c3d438b8b930a7d0d5e61112327f8e: 2023-09-14 07:02:34,849 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fb1077524cd291853d0842c59bd3379c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63291401, jitterRate=-0.056884631514549255}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-14 07:02:34,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fb1077524cd291853d0842c59bd3379c: 2023-09-14 07:02:34,849 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1694674954474.e0c3d438b8b930a7d0d5e61112327f8e., pid=108, masterSystemTime=1694674954835 2023-09-14 07:02:34,849 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1694674954474.fb1077524cd291853d0842c59bd3379c., pid=109, masterSystemTime=1694674954836 2023-09-14 07:02:34,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1694674954474.e0c3d438b8b930a7d0d5e61112327f8e. 2023-09-14 07:02:34,851 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1694674954474.e0c3d438b8b930a7d0d5e61112327f8e. 2023-09-14 07:02:34,851 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=e0c3d438b8b930a7d0d5e61112327f8e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:34,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1694674954474.fb1077524cd291853d0842c59bd3379c. 2023-09-14 07:02:34,851 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1694674954474.fb1077524cd291853d0842c59bd3379c. 2023-09-14 07:02:34,851 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694674954474.e0c3d438b8b930a7d0d5e61112327f8e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694674954851"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694674954851"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694674954851"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694674954851"}]},"ts":"1694674954851"} 2023-09-14 07:02:34,852 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=fb1077524cd291853d0842c59bd3379c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:34,852 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694674954474.fb1077524cd291853d0842c59bd3379c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694674954852"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694674954852"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694674954852"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694674954852"}]},"ts":"1694674954852"} 2023-09-14 07:02:34,854 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=107 2023-09-14 07:02:34,854 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure e0c3d438b8b930a7d0d5e61112327f8e, server=jenkins-hbase4.apache.org,41005,1694674856735 in 170 msec 2023-09-14 07:02:34,855 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=106 2023-09-14 07:02:34,855 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e0c3d438b8b930a7d0d5e61112327f8e, ASSIGN in 329 msec 2023-09-14 07:02:34,855 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure fb1077524cd291853d0842c59bd3379c, server=jenkins-hbase4.apache.org,35941,1694674856649 in 171 msec 2023-09-14 07:02:34,857 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=106, resume processing ppid=105 2023-09-14 07:02:34,857 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=fb1077524cd291853d0842c59bd3379c, ASSIGN in 331 msec 2023-09-14 07:02:34,858 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-14 07:02:34,858 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694674954858"}]},"ts":"1694674954858"} 2023-09-14 07:02:34,859 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-09-14 07:02:34,861 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-09-14 07:02:34,862 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-09-14 07:02:34,863 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35941] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-14 07:02:34,866 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 07:02:34,866 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 07:02:34,866 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 07:02:34,866 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 07:02:34,867 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-14 07:02:34,867 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-14 07:02:34,867 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-14 07:02:34,867 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-14 07:02:34,868 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 392 msec 2023-09-14 07:02:35,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-14 07:02:35,082 INFO [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-09-14 07:02:35,084 DEBUG [Listener at jenkins-hbase4.apache.org/40843] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,084 DEBUG [Listener at jenkins-hbase4.apache.org/40843] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1694674954474.fb1077524cd291853d0842c59bd3379c. 2023-09-14 07:02:35,086 INFO [Listener at jenkins-hbase4.apache.org/40843] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-14 07:02:35,096 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-14 07:02:35,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694674955096 (current time:1694674955096). 2023-09-14 07:02:35,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-14 07:02:35,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] zookeeper.ReadOnlyZKClient(139): Connect 0x6704e959 to 127.0.0.1:52295 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 07:02:35,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@75a4802c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 07:02:35,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 07:02:35,110 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36804, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 07:02:35,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6704e959 to 127.0.0.1:52295 2023-09-14 07:02:35,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 07:02:35,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] zookeeper.ReadOnlyZKClient(139): Connect 0x55b7e267 to 127.0.0.1:52295 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 07:02:35,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@15b997a9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 07:02:35,119 DEBUG [hconnection-0x444dc0d2-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 07:02:35,121 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36816, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 07:02:35,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 07:02:35,127 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35298, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 07:02:35,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x55b7e267 to 127.0.0.1:52295 2023-09-14 07:02:35,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 07:02:35,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-14 07:02:35,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-14 07:02:35,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-14 07:02:35,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-14 07:02:35,132 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-14 07:02:35,133 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1694675555132 2023-09-14 07:02:35,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-14 07:02:35,133 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,134 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-14 07:02:35,134 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-14 07:02:35,135 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-14 07:02:35,135 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-14 07:02:35,136 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-09-14 07:02:35,136 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-14 07:02:35,137 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1694675555137 2023-09-14 07:02:35,148 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,148 INFO [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-14 07:02:35,148 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 07:02:35,150 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-14 07:02:35,150 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-14 07:02:35,150 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,150 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,151 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:02:35,151 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:02:35,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:02:35,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:02:35,151 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:35,151 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:02:35,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:02:35,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:02:35,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:02:35,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:02:35,152 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:35,152 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:35,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,152 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:35,152 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-14 07:02:35,152 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,152 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-14 07:02:35,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-14 07:02:35,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,153 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-14 07:02:35,153 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-14 07:02:35,153 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,153 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,153 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-14 07:02:35,153 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 07:02:35,153 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-14 07:02:35,154 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-14 07:02:35,154 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,154 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 07:02:35,154 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-14 07:02:35,155 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-14 07:02:35,155 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-14 07:02:35,155 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41005,1694674856735' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-14 07:02:35,155 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35941,1694674856649' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-14 07:02:35,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-14 07:02:35,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,156 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-14 07:02:35,156 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,156 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-14 07:02:35,156 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 07:02:35,157 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-14 07:02:35,157 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-14 07:02:35,157 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37703,1694674856695' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-14 07:02:35,162 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:35,162 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:35,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:02:35,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:02:35,163 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:35,163 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,163 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,164 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 07:02:35,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:02:35,165 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,165 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,165 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 07:02:35,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:02:35,165 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,165 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 07:02:35,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:35,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:35,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:35,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:02:35,166 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41005,1694674856735' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-14 07:02:35,166 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@34ed3a4c[Count = 1] remaining members to acquire global barrier 2023-09-14 07:02:35,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:35,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:02:35,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:02:35,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:02:35,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:02:35,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:35,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:35,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:35,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:02:35,168 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35941,1694674856649' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-14 07:02:35,168 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@34ed3a4c[Count = 0] remaining members to acquire global barrier 2023-09-14 07:02:35,168 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-14 07:02:35,168 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,169 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,169 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,170 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:35,170 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-14 07:02:35,169 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,170 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-14 07:02:35,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,170 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-14 07:02:35,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,170 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1694674954474.e0c3d438b8b930a7d0d5e61112327f8e. 2023-09-14 07:02:35,170 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-14 07:02:35,170 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-14 07:02:35,170 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1694674954474.e0c3d438b8b930a7d0d5e61112327f8e. started... 2023-09-14 07:02:35,170 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:35,170 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-14 07:02:35,170 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-14 07:02:35,170 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37703,1694674856695' in zk 2023-09-14 07:02:35,171 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e0c3d438b8b930a7d0d5e61112327f8e: 2023-09-14 07:02:35,171 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-14 07:02:35,172 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1694674954474.e0c3d438b8b930a7d0d5e61112327f8e.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,172 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1694674954474.fb1077524cd291853d0842c59bd3379c. 2023-09-14 07:02:35,172 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-14 07:02:35,172 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1694674954474.fb1077524cd291853d0842c59bd3379c. started... 2023-09-14 07:02:35,172 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-14 07:02:35,172 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-14 07:02:35,172 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fb1077524cd291853d0842c59bd3379c: 2023-09-14 07:02:35,172 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1694674954474.fb1077524cd291853d0842c59bd3379c.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,172 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-14 07:02:35,172 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-14 07:02:35,174 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-14 07:02:35,174 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 07:02:35,174 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-14 07:02:35,187 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1694674954474.e0c3d438b8b930a7d0d5e61112327f8e. completed. 2023-09-14 07:02:35,187 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1694674954474.e0c3d438b8b930a7d0d5e61112327f8e. 2023-09-14 07:02:35,187 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-14 07:02:35,187 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-14 07:02:35,187 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:35,188 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-14 07:02:35,188 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,41005,1694674856735' in zk 2023-09-14 07:02:35,189 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1694674954474.fb1077524cd291853d0842c59bd3379c. completed. 2023-09-14 07:02:35,189 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1694674954474.fb1077524cd291853d0842c59bd3379c. 2023-09-14 07:02:35,189 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-14 07:02:35,189 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-14 07:02:35,189 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:35,189 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-14 07:02:35,189 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35941,1694674856649' in zk 2023-09-14 07:02:35,189 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-14 07:02:35,189 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 07:02:35,189 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:35,189 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-14 07:02:35,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:35,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:02:35,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:02:35,192 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:35,192 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-14 07:02:35,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:02:35,192 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 07:02:35,192 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-14 07:02:35,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:02:35,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:35,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:35,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:35,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:02:35,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:35,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:35,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:35,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,41005,1694674856735': 2023-09-14 07:02:35,196 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41005,1694674856735' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-14 07:02:35,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:35,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:02:35,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:02:35,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:02:35,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:02:35,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:35,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:35,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:35,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:02:35,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:35,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:35,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:35,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,35941,1694674856649': 2023-09-14 07:02:35,199 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35941,1694674856649' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-14 07:02:35,199 INFO [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-14 07:02:35,199 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-14 07:02:35,199 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-14 07:02:35,199 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,199 INFO [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-14 07:02:35,201 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,201 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,201 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,201 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:02:35,201 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:02:35,201 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:02:35,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:02:35,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,202 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:02:35,202 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:35,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:02:35,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:02:35,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:02:35,202 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:35,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:02:35,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:02:35,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:02:35,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:02:35,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,203 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:35,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:02:35,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:35,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:35,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:35,204 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:35,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:02:35,204 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:35,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,205 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:35,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:35,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:35,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:35,208 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:35,208 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:02:35,208 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:02:35,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:02:35,208 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:02:35,208 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,208 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:35,208 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:02:35,208 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:35,209 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:02:35,208 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:02:35,209 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:02:35,208 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 07:02:35,208 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:02:35,209 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-14 07:02:35,209 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:02:35,209 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:02:35,210 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:35,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:02:35,210 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:02:35,210 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:35,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:02:35,210 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:35,210 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,210 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,211 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-14 07:02:35,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:02:35,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:02:35,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:02:35,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:02:35,218 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,219 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,233 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,234 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-14 07:02:35,234 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-14 07:02:35,234 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,234 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,235 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1694674955133Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1694674955218 (+85 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1694674955218Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1694674955218Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1694674955221 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1694674955229 (+8 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1694674955234 (+5 ms) 2023-09-14 07:02:35,237 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-14 07:02:35,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-14 07:02:35,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-14 07:02:35,239 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 104 msec 2023-09-14 07:02:35,240 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35941] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1694674954474.fb1077524cd291853d0842c59bd3379c. with WAL disabled. Data may be lost in the event of a crash. 2023-09-14 07:02:35,240 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41005] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1694674954474.e0c3d438b8b930a7d0d5e61112327f8e. with WAL disabled. Data may be lost in the event of a crash. 2023-09-14 07:02:35,243 DEBUG [Listener at jenkins-hbase4.apache.org/40843] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,243 DEBUG [Listener at jenkins-hbase4.apache.org/40843] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1694674954474.fb1077524cd291853d0842c59bd3379c. 2023-09-14 07:02:35,243 INFO [Listener at jenkins-hbase4.apache.org/40843] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-14 07:02:35,251 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-14 07:02:35,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694674955252 (current time:1694674955252). 2023-09-14 07:02:35,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-14 07:02:35,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] zookeeper.ReadOnlyZKClient(139): Connect 0x71c71b3b to 127.0.0.1:52295 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 07:02:35,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@255803db, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 07:02:35,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 07:02:35,260 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36824, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 07:02:35,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x71c71b3b to 127.0.0.1:52295 2023-09-14 07:02:35,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 07:02:35,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] zookeeper.ReadOnlyZKClient(139): Connect 0x07d18543 to 127.0.0.1:52295 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 07:02:35,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e065841, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 07:02:35,268 DEBUG [hconnection-0x2b25dc81-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 07:02:35,275 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36826, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 07:02:35,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 07:02:35,281 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57534, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 07:02:35,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x07d18543 to 127.0.0.1:52295 2023-09-14 07:02:35,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 07:02:35,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-14 07:02:35,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-14 07:02:35,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-14 07:02:35,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-14 07:02:35,286 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-14 07:02:35,286 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1694675555286 2023-09-14 07:02:35,286 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-14 07:02:35,287 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-14 07:02:35,287 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-14 07:02:35,288 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-14 07:02:35,288 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-14 07:02:35,289 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-09-14 07:02:35,290 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-14 07:02:35,291 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1694675555291 2023-09-14 07:02:35,302 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,302 INFO [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-14 07:02:35,302 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 07:02:35,304 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-14 07:02:35,304 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-14 07:02:35,304 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,304 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,306 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:02:35,306 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:02:35,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:02:35,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:02:35,306 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:35,306 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:02:35,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:02:35,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:02:35,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:02:35,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:02:35,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,306 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:35,307 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:35,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,307 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,307 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,307 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:35,307 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-14 07:02:35,307 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-14 07:02:35,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-14 07:02:35,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,307 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-14 07:02:35,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-14 07:02:35,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,307 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-14 07:02:35,308 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,308 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-14 07:02:35,308 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,308 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-14 07:02:35,308 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 07:02:35,308 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,309 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-14 07:02:35,309 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 07:02:35,309 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-14 07:02:35,310 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-14 07:02:35,310 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-14 07:02:35,311 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35941,1694674856649' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-14 07:02:35,309 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-14 07:02:35,311 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 07:02:35,311 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-14 07:02:35,312 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-14 07:02:35,312 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41005,1694674856735' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-14 07:02:35,312 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-14 07:02:35,312 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37703,1694674856695' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-14 07:02:35,313 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,313 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:35,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:35,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:02:35,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:02:35,314 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:35,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:02:35,314 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,314 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,314 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,314 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 07:02:35,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:02:35,315 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,316 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,316 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 07:02:35,316 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 07:02:35,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:35,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:35,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:35,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:02:35,317 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35941,1694674856649' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-14 07:02:35,317 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5179f7e2[Count = 1] remaining members to acquire global barrier 2023-09-14 07:02:35,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:35,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:02:35,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:02:35,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:02:35,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:02:35,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:35,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:35,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:35,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:02:35,319 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41005,1694674856735' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-14 07:02:35,319 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5179f7e2[Count = 0] remaining members to acquire global barrier 2023-09-14 07:02:35,319 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-14 07:02:35,319 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,324 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,324 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,324 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,324 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-14 07:02:35,324 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-14 07:02:35,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,324 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:35,324 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-14 07:02:35,324 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-14 07:02:35,324 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-14 07:02:35,324 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1694674954474.fb1077524cd291853d0842c59bd3379c. 2023-09-14 07:02:35,325 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-14 07:02:35,324 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37703,1694674856695' in zk 2023-09-14 07:02:35,324 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1694674954474.e0c3d438b8b930a7d0d5e61112327f8e. 2023-09-14 07:02:35,324 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-14 07:02:35,325 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1694674954474.e0c3d438b8b930a7d0d5e61112327f8e. started... 2023-09-14 07:02:35,325 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-14 07:02:35,325 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:35,325 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-14 07:02:35,325 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1694674954474.fb1077524cd291853d0842c59bd3379c. started... 2023-09-14 07:02:35,325 INFO [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e0c3d438b8b930a7d0d5e61112327f8e 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-09-14 07:02:35,325 INFO [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] regionserver.HRegion(2745): Flushing fb1077524cd291853d0842c59bd3379c 1/1 column families, dataSize=333 B heapSize=976 B 2023-09-14 07:02:35,326 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-14 07:02:35,326 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 07:02:35,326 DEBUG [member: 'jenkins-hbase4.apache.org,37703,1694674856695' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-14 07:02:35,349 INFO [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230914cc80d211b8904b879c3d3ea15a4c8932 to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230914cc80d211b8904b879c3d3ea15a4c8932 2023-09-14 07:02:35,351 INFO [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230914830d73ea4c444af2886c67584a1dbed7 to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230914830d73ea4c444af2886c67584a1dbed7 2023-09-14 07:02:35,364 INFO [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithSkipTmp/fb1077524cd291853d0842c59bd3379c/.tmp/cf/9c39bf65d0dc463285a244759fee2d66 2023-09-14 07:02:35,367 INFO [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithSkipTmp/e0c3d438b8b930a7d0d5e61112327f8e/.tmp/cf/3325bd2009dd498fa577d6572660068e 2023-09-14 07:02:35,370 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithSkipTmp/fb1077524cd291853d0842c59bd3379c/.tmp/cf/9c39bf65d0dc463285a244759fee2d66 as hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithSkipTmp/fb1077524cd291853d0842c59bd3379c/cf/9c39bf65d0dc463285a244759fee2d66 2023-09-14 07:02:35,371 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithSkipTmp/e0c3d438b8b930a7d0d5e61112327f8e/.tmp/cf/3325bd2009dd498fa577d6572660068e as hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithSkipTmp/e0c3d438b8b930a7d0d5e61112327f8e/cf/3325bd2009dd498fa577d6572660068e 2023-09-14 07:02:35,374 INFO [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithSkipTmp/fb1077524cd291853d0842c59bd3379c/cf/9c39bf65d0dc463285a244759fee2d66, entries=5, sequenceid=6, filesize=5.8 K 2023-09-14 07:02:35,375 INFO [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for fb1077524cd291853d0842c59bd3379c in 50ms, sequenceid=6, compaction requested=false 2023-09-14 07:02:35,375 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-14 07:02:35,376 INFO [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithSkipTmp/e0c3d438b8b930a7d0d5e61112327f8e/cf/3325bd2009dd498fa577d6572660068e, entries=45, sequenceid=6, filesize=13.0 K 2023-09-14 07:02:35,376 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fb1077524cd291853d0842c59bd3379c: 2023-09-14 07:02:35,376 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1694674954474.fb1077524cd291853d0842c59bd3379c.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,376 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-14 07:02:35,376 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithSkipTmp/fb1077524cd291853d0842c59bd3379c/cf/9c39bf65d0dc463285a244759fee2d66] hfiles 2023-09-14 07:02:35,376 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithSkipTmp/fb1077524cd291853d0842c59bd3379c/cf/9c39bf65d0dc463285a244759fee2d66 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,376 INFO [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for e0c3d438b8b930a7d0d5e61112327f8e in 51ms, sequenceid=6, compaction requested=false 2023-09-14 07:02:35,378 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e0c3d438b8b930a7d0d5e61112327f8e: 2023-09-14 07:02:35,378 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1694674954474.e0c3d438b8b930a7d0d5e61112327f8e.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,378 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-14 07:02:35,378 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithSkipTmp/e0c3d438b8b930a7d0d5e61112327f8e/cf/3325bd2009dd498fa577d6572660068e] hfiles 2023-09-14 07:02:35,378 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithSkipTmp/e0c3d438b8b930a7d0d5e61112327f8e/cf/3325bd2009dd498fa577d6572660068e for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,384 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1694674954474.e0c3d438b8b930a7d0d5e61112327f8e. completed. 2023-09-14 07:02:35,384 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1694674954474.fb1077524cd291853d0842c59bd3379c. completed. 2023-09-14 07:02:35,384 DEBUG [rs(jenkins-hbase4.apache.org,35941,1694674856649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1694674954474.fb1077524cd291853d0842c59bd3379c. 2023-09-14 07:02:35,384 DEBUG [rs(jenkins-hbase4.apache.org,41005,1694674856735)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1694674954474.e0c3d438b8b930a7d0d5e61112327f8e. 2023-09-14 07:02:35,384 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-14 07:02:35,384 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-14 07:02:35,384 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-14 07:02:35,384 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:35,384 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-14 07:02:35,384 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:35,384 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-14 07:02:35,384 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-14 07:02:35,384 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,41005,1694674856735' in zk 2023-09-14 07:02:35,385 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35941,1694674856649' in zk 2023-09-14 07:02:35,386 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-14 07:02:35,386 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-14 07:02:35,386 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:35,386 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 07:02:35,386 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:35,386 DEBUG [member: 'jenkins-hbase4.apache.org,35941,1694674856649' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-14 07:02:35,386 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 07:02:35,388 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-14 07:02:35,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:35,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:02:35,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:02:35,388 DEBUG [member: 'jenkins-hbase4.apache.org,41005,1694674856735' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-14 07:02:35,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:02:35,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:02:35,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-14 07:02:35,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-14 07:02:35,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,390 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-14 07:02:35,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:35,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:35,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:35,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:02:35,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:35,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:35,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:35,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,41005,1694674856735': 2023-09-14 07:02:35,392 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41005,1694674856735' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-14 07:02:35,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:35,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:02:35,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:02:35,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:02:35,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:02:35,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:35,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:35,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:35,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:02:35,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:35,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:35,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:35,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,35941,1694674856649': 2023-09-14 07:02:35,395 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35941,1694674856649' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-14 07:02:35,395 INFO [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-14 07:02:35,395 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-14 07:02:35,395 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-14 07:02:35,395 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,395 INFO [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-14 07:02:35,396 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,396 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,396 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,397 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:02:35,396 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,397 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:02:35,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 07:02:35,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 07:02:35,397 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:02:35,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,397 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:35,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:02:35,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:02:35,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 07:02:35,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:02:35,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:02:35,397 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:35,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:02:35,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:02:35,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,398 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:35,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 07:02:35,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:35,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:35,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:35,399 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:35,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 07:02:35,400 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:35,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,400 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:35,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:35,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:35,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:35,405 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:02:35,405 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:02:35,405 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 07:02:35,405 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:02:35,405 DEBUG [(jenkins-hbase4.apache.org,33055,1694674855392)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 07:02:35,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:02:35,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:02:35,405 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:02:35,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:02:35,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:02:35,405 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:02:35,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:02:35,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 07:02:35,405 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 07:02:35,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 07:02:35,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:02:35,407 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:02:35,407 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,407 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-14 07:02:35,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 07:02:35,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 07:02:35,408 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230914830d73ea4c444af2886c67584a1dbed7, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230914cc80d211b8904b879c3d3ea15a4c8932] mob files 2023-09-14 07:02:35,408 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230914830d73ea4c444af2886c67584a1dbed7 2023-09-14 07:02:35,408 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230914cc80d211b8904b879c3d3ea15a4c8932 2023-09-14 07:02:35,409 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:35,409 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,409 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:35,409 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:35,409 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,409 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:35,409 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,409 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:02:35,409 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:35,409 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,409 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,414 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,416 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,431 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,432 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-14 07:02:35,432 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,432 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,432 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1694674955286Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1694674955414 (+128 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1694674955414Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1694674955415 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1694674955419 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1694674955425 (+6 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1694674955432 (+7 ms) 2023-09-14 07:02:35,435 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-14 07:02:35,436 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 148 msec 2023-09-14 07:02:35,590 DEBUG [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-14 07:02:35,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-14 07:02:35,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-14 07:02:35,591 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/export-test/export-1694674955591 2023-09-14 07:02:35,591 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44283, tgtDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/export-test/export-1694674955591, rawTgtDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/export-test/export-1694674955591, srcFsUri=hdfs://localhost:44283, srcDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04 2023-09-14 07:02:35,613 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44283, inputRoot=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04 2023-09-14 07:02:35,613 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1683338190_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/export-test/export-1694674955591, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/export-test/export-1694674955591/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,613 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44283, inputRoot=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04, snapshotDir=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-09-14 07:02:35,624 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/export-test/export-1694674955591/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:35,647 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-14 07:02:35,647 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-14 07:02:35,648 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-14 07:02:35,648 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-14 07:02:36,519 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/hadoop-1057888935552773410.jar 2023-09-14 07:02:36,520 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-14 07:02:36,520 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-14 07:02:36,586 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/hadoop-8295064361191563758.jar 2023-09-14 07:02:36,587 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-14 07:02:36,587 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-14 07:02:36,587 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-14 07:02:36,588 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-14 07:02:36,588 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-14 07:02:36,588 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-14 07:02:36,589 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-14 07:02:36,589 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-14 07:02:36,589 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-14 07:02:36,590 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-14 07:02:36,590 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-14 07:02:36,590 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-14 07:02:36,591 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-14 07:02:36,591 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-14 07:02:36,591 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-14 07:02:36,592 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-14 07:02:36,592 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 07:02:36,593 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 07:02:36,593 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-14 07:02:36,594 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 07:02:36,594 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 07:02:36,594 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-14 07:02:36,595 DEBUG [Listener at jenkins-hbase4.apache.org/40843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-14 07:02:36,966 WARN [Listener at jenkins-hbase4.apache.org/40843] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-14 07:02:36,968 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-09-14 07:02:36,970 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-09-14 07:02:38,932 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-14 07:02:38,932 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-14 07:02:38,935 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694674863103_0006_000001 (auth:SIMPLE) 2023-09-14 07:02:39,751 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-14 07:02:39,893 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694674863103_0007_000001 (auth:SIMPLE) 2023-09-14 07:02:43,620 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694674863103_0007_000001 (auth:SIMPLE) 2023-09-14 07:02:45,826 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694674863103_0007_000001 (auth:SIMPLE) 2023-09-14 07:02:48,359 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694674863103_0007_000001 (auth:SIMPLE) 2023-09-14 07:02:50,127 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-14 07:02:50,127 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-14 07:02:50,139 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:50,139 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-14 07:02:50,139 INFO [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-14 07:02:50,139 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_409472800_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:50,140 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(367): hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-14 07:02:50,140 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(367): hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-14 07:02:50,140 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_409472800_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/export-test/export-1694674955591/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/export-test/export-1694674955591/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:50,140 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(367): hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/export-test/export-1694674955591/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-14 07:02:50,140 DEBUG [Listener at jenkins-hbase4.apache.org/40843] snapshot.TestExportSnapshot(367): hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/export-test/export-1694674955591/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-14 07:02:50,145 INFO [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:50,146 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:50,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:50,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-14 07:02:50,149 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694674970149"}]},"ts":"1694674970149"} 2023-09-14 07:02:50,150 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-09-14 07:02:50,152 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-09-14 07:02:50,152 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=fb1077524cd291853d0842c59bd3379c, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e0c3d438b8b930a7d0d5e61112327f8e, UNASSIGN}] 2023-09-14 07:02:50,154 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=fb1077524cd291853d0842c59bd3379c, UNASSIGN 2023-09-14 07:02:50,154 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e0c3d438b8b930a7d0d5e61112327f8e, UNASSIGN 2023-09-14 07:02:50,155 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=fb1077524cd291853d0842c59bd3379c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:02:50,155 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=e0c3d438b8b930a7d0d5e61112327f8e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:02:50,155 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694674954474.fb1077524cd291853d0842c59bd3379c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694674970154"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694674970154"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694674970154"}]},"ts":"1694674970154"} 2023-09-14 07:02:50,155 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694674954474.e0c3d438b8b930a7d0d5e61112327f8e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694674970155"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694674970155"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694674970155"}]},"ts":"1694674970155"} 2023-09-14 07:02:50,156 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure fb1077524cd291853d0842c59bd3379c, server=jenkins-hbase4.apache.org,35941,1694674856649}] 2023-09-14 07:02:50,156 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure e0c3d438b8b930a7d0d5e61112327f8e, server=jenkins-hbase4.apache.org,41005,1694674856735}] 2023-09-14 07:02:50,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-14 07:02:50,308 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close fb1077524cd291853d0842c59bd3379c 2023-09-14 07:02:50,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fb1077524cd291853d0842c59bd3379c, disabling compactions & flushes 2023-09-14 07:02:50,308 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1694674954474.fb1077524cd291853d0842c59bd3379c. 2023-09-14 07:02:50,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1694674954474.fb1077524cd291853d0842c59bd3379c. 2023-09-14 07:02:50,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1694674954474.fb1077524cd291853d0842c59bd3379c. after waiting 0 ms 2023-09-14 07:02:50,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1694674954474.fb1077524cd291853d0842c59bd3379c. 2023-09-14 07:02:50,312 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e0c3d438b8b930a7d0d5e61112327f8e 2023-09-14 07:02:50,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e0c3d438b8b930a7d0d5e61112327f8e, disabling compactions & flushes 2023-09-14 07:02:50,312 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1694674954474.e0c3d438b8b930a7d0d5e61112327f8e. 2023-09-14 07:02:50,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1694674954474.e0c3d438b8b930a7d0d5e61112327f8e. 2023-09-14 07:02:50,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1694674954474.e0c3d438b8b930a7d0d5e61112327f8e. after waiting 0 ms 2023-09-14 07:02:50,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1694674954474.e0c3d438b8b930a7d0d5e61112327f8e. 2023-09-14 07:02:50,320 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithSkipTmp/fb1077524cd291853d0842c59bd3379c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-14 07:02:50,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/default/testtb-testExportFileSystemStateWithSkipTmp/e0c3d438b8b930a7d0d5e61112327f8e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-14 07:02:50,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-14 07:02:50,321 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1694674954474.fb1077524cd291853d0842c59bd3379c. 2023-09-14 07:02:50,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fb1077524cd291853d0842c59bd3379c: 2023-09-14 07:02:50,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-14 07:02:50,322 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1694674954474.e0c3d438b8b930a7d0d5e61112327f8e. 2023-09-14 07:02:50,323 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e0c3d438b8b930a7d0d5e61112327f8e: 2023-09-14 07:02:50,323 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed fb1077524cd291853d0842c59bd3379c 2023-09-14 07:02:50,324 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=fb1077524cd291853d0842c59bd3379c, regionState=CLOSED 2023-09-14 07:02:50,324 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694674954474.fb1077524cd291853d0842c59bd3379c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694674970324"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694674970324"}]},"ts":"1694674970324"} 2023-09-14 07:02:50,324 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e0c3d438b8b930a7d0d5e61112327f8e 2023-09-14 07:02:50,324 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=e0c3d438b8b930a7d0d5e61112327f8e, regionState=CLOSED 2023-09-14 07:02:50,324 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694674954474.e0c3d438b8b930a7d0d5e61112327f8e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694674970324"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694674970324"}]},"ts":"1694674970324"} 2023-09-14 07:02:50,327 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=115 2023-09-14 07:02:50,327 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure fb1077524cd291853d0842c59bd3379c, server=jenkins-hbase4.apache.org,35941,1694674856649 in 169 msec 2023-09-14 07:02:50,327 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-09-14 07:02:50,328 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=fb1077524cd291853d0842c59bd3379c, UNASSIGN in 175 msec 2023-09-14 07:02:50,328 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure e0c3d438b8b930a7d0d5e61112327f8e, server=jenkins-hbase4.apache.org,41005,1694674856735 in 170 msec 2023-09-14 07:02:50,329 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=116, resume processing ppid=114 2023-09-14 07:02:50,329 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e0c3d438b8b930a7d0d5e61112327f8e, UNASSIGN in 176 msec 2023-09-14 07:02:50,329 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694674970329"}]},"ts":"1694674970329"} 2023-09-14 07:02:50,330 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-09-14 07:02:50,332 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-09-14 07:02:50,333 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 186 msec 2023-09-14 07:02:50,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-14 07:02:50,451 INFO [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-09-14 07:02:50,452 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:50,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:50,455 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:50,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:50,456 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:50,457 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35941] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:50,459 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fb1077524cd291853d0842c59bd3379c 2023-09-14 07:02:50,459 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e0c3d438b8b930a7d0d5e61112327f8e 2023-09-14 07:02:50,460 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:50,460 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:50,460 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:50,460 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:50,461 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-14 07:02:50,461 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-14 07:02:50,461 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-14 07:02:50,461 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-14 07:02:50,461 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fb1077524cd291853d0842c59bd3379c/cf, FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fb1077524cd291853d0842c59bd3379c/recovered.edits] 2023-09-14 07:02:50,462 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e0c3d438b8b930a7d0d5e61112327f8e/cf, FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e0c3d438b8b930a7d0d5e61112327f8e/recovered.edits] 2023-09-14 07:02:50,462 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:50,462 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:50,462 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 07:02:50,462 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:50,462 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:50,462 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 07:02:50,462 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 07:02:50,462 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 07:02:50,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-14 07:02:50,465 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e0c3d438b8b930a7d0d5e61112327f8e/cf/3325bd2009dd498fa577d6572660068e to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e0c3d438b8b930a7d0d5e61112327f8e/cf/3325bd2009dd498fa577d6572660068e 2023-09-14 07:02:50,465 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fb1077524cd291853d0842c59bd3379c/cf/9c39bf65d0dc463285a244759fee2d66 to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/fb1077524cd291853d0842c59bd3379c/cf/9c39bf65d0dc463285a244759fee2d66 2023-09-14 07:02:50,468 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e0c3d438b8b930a7d0d5e61112327f8e/recovered.edits/9.seqid to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e0c3d438b8b930a7d0d5e61112327f8e/recovered.edits/9.seqid 2023-09-14 07:02:50,468 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fb1077524cd291853d0842c59bd3379c/recovered.edits/9.seqid to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/fb1077524cd291853d0842c59bd3379c/recovered.edits/9.seqid 2023-09-14 07:02:50,469 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e0c3d438b8b930a7d0d5e61112327f8e 2023-09-14 07:02:50,469 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fb1077524cd291853d0842c59bd3379c 2023-09-14 07:02:50,469 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-14 07:02:50,469 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-14 07:02:50,470 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-09-14 07:02:50,473 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230914830d73ea4c444af2886c67584a1dbed7 to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230914830d73ea4c444af2886c67584a1dbed7 2023-09-14 07:02:50,474 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230914cc80d211b8904b879c3d3ea15a4c8932 to hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230914cc80d211b8904b879c3d3ea15a4c8932 2023-09-14 07:02:50,474 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-14 07:02:50,476 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:50,478 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-09-14 07:02:50,479 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-09-14 07:02:50,480 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:50,480 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-09-14 07:02:50,480 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694674954474.fb1077524cd291853d0842c59bd3379c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694674970480"}]},"ts":"9223372036854775807"} 2023-09-14 07:02:50,480 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694674954474.e0c3d438b8b930a7d0d5e61112327f8e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694674970480"}]},"ts":"9223372036854775807"} 2023-09-14 07:02:50,482 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-14 07:02:50,482 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => fb1077524cd291853d0842c59bd3379c, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1694674954474.fb1077524cd291853d0842c59bd3379c.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => e0c3d438b8b930a7d0d5e61112327f8e, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1694674954474.e0c3d438b8b930a7d0d5e61112327f8e.', STARTKEY => '1', ENDKEY => ''}] 2023-09-14 07:02:50,482 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-09-14 07:02:50,482 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694674970482"}]},"ts":"9223372036854775807"} 2023-09-14 07:02:50,483 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-09-14 07:02:50,485 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:50,486 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 33 msec 2023-09-14 07:02:50,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-14 07:02:50,564 INFO [Listener at jenkins-hbase4.apache.org/40843] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-09-14 07:02:50,570 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-14 07:02:50,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:50,573 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-14 07:02:50,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33055] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 07:02:50,598 INFO [Listener at jenkins-hbase4.apache.org/40843] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765 (was 766), OpenFileDescriptor=911 (was 930), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=139 (was 170), ProcessCount=168 (was 168), AvailableMemoryMB=8192 (was 8270) 2023-09-14 07:02:50,598 WARN [Listener at jenkins-hbase4.apache.org/40843] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-09-14 07:02:50,598 INFO [Listener at jenkins-hbase4.apache.org/40843] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-09-14 07:02:50,609 INFO [Listener at jenkins-hbase4.apache.org/40843] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-14 07:02:50,719 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1694674863103_0007_01_000001 is : 143 2023-09-14 07:02:55,887 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-14 07:03:04,732 INFO [Listener at jenkins-hbase4.apache.org/40843] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-14 07:03:18,848 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-14 07:03:18,849 INFO [Listener at jenkins-hbase4.apache.org/40843] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-14 07:03:18,956 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-09-14 07:03:18,967 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-09-14 07:03:18,968 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-14 07:03:18,978 INFO [Listener at jenkins-hbase4.apache.org/40843] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-14 07:03:19,081 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-14 07:03:19,081 INFO [Listener at jenkins-hbase4.apache.org/40843] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-09-14 07:03:19,081 INFO [Listener at jenkins-hbase4.apache.org/40843] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-09-14 07:03:19,081 INFO [Listener at jenkins-hbase4.apache.org/40843] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-09-14 07:03:19,081 DEBUG [Listener at jenkins-hbase4.apache.org/40843] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x392976b2 to 127.0.0.1:52295 2023-09-14 07:03:19,081 DEBUG [Listener at jenkins-hbase4.apache.org/40843] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 07:03:19,082 DEBUG [Listener at jenkins-hbase4.apache.org/40843] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-09-14 07:03:19,082 DEBUG [Listener at jenkins-hbase4.apache.org/40843] util.JVMClusterUtil(257): Found active master hash=424085169, stopped=false 2023-09-14 07:03:19,082 DEBUG [Listener at jenkins-hbase4.apache.org/40843] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-14 07:03:19,082 DEBUG [Listener at jenkins-hbase4.apache.org/40843] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-14 07:03:19,082 INFO [Listener at jenkins-hbase4.apache.org/40843] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,33055,1694674855392 2023-09-14 07:03:19,084 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-14 07:03:19,084 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-14 07:03:19,084 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-14 07:03:19,084 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-14 07:03:19,084 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-14 07:03:19,084 INFO [Listener at jenkins-hbase4.apache.org/40843] procedure2.ProcedureExecutor(628): Stopping 2023-09-14 07:03:19,084 DEBUG [Listener at jenkins-hbase4.apache.org/40843] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x54473360 to 127.0.0.1:52295 2023-09-14 07:03:19,084 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-14 07:03:19,084 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-14 07:03:19,084 DEBUG [Listener at jenkins-hbase4.apache.org/40843] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 07:03:19,084 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-14 07:03:19,084 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-14 07:03:19,085 INFO [Listener at jenkins-hbase4.apache.org/40843] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,35941,1694674856649' ***** 2023-09-14 07:03:19,085 DEBUG [Listener at jenkins-hbase4.apache.org/40843] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-14 07:03:19,085 INFO [Listener at jenkins-hbase4.apache.org/40843] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-14 07:03:19,085 INFO [Listener at jenkins-hbase4.apache.org/40843] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,37703,1694674856695' ***** 2023-09-14 07:03:19,085 DEBUG [Listener at jenkins-hbase4.apache.org/40843] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-14 07:03:19,085 INFO [Listener at jenkins-hbase4.apache.org/40843] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-14 07:03:19,085 INFO [RS:0;jenkins-hbase4:35941] regionserver.HeapMemoryManager(220): Stopping 2023-09-14 07:03:19,085 INFO [Listener at jenkins-hbase4.apache.org/40843] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,41005,1694674856735' ***** 2023-09-14 07:03:19,085 INFO [RS:1;jenkins-hbase4:37703] regionserver.HeapMemoryManager(220): Stopping 2023-09-14 07:03:19,085 INFO [RS:0;jenkins-hbase4:35941] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-14 07:03:19,085 INFO [RS:1;jenkins-hbase4:37703] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-14 07:03:19,086 INFO [RS:0;jenkins-hbase4:35941] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-14 07:03:19,085 DEBUG [Listener at jenkins-hbase4.apache.org/40843] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-14 07:03:19,086 INFO [RS:1;jenkins-hbase4:37703] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-14 07:03:19,085 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-14 07:03:19,086 INFO [RS:1;jenkins-hbase4:37703] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:03:19,086 INFO [RS:0;jenkins-hbase4:35941] regionserver.HRegionServer(3305): Received CLOSE for e8c7a8a714ce5b83c0178f59f5b781c8 2023-09-14 07:03:19,085 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-14 07:03:19,086 DEBUG [RS:1;jenkins-hbase4:37703] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x67ae90ba to 127.0.0.1:52295 2023-09-14 07:03:19,086 INFO [Listener at jenkins-hbase4.apache.org/40843] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-14 07:03:19,086 DEBUG [RS:1;jenkins-hbase4:37703] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 07:03:19,088 INFO [RS:2;jenkins-hbase4:41005] regionserver.HeapMemoryManager(220): Stopping 2023-09-14 07:03:19,088 INFO [RS:0;jenkins-hbase4:35941] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:03:19,089 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-14 07:03:19,089 DEBUG [RS:0;jenkins-hbase4:35941] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6daea4b0 to 127.0.0.1:52295 2023-09-14 07:03:19,088 INFO [RS:1;jenkins-hbase4:37703] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-14 07:03:19,089 DEBUG [RS:0;jenkins-hbase4:35941] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 07:03:19,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e8c7a8a714ce5b83c0178f59f5b781c8, disabling compactions & flushes 2023-09-14 07:03:19,089 INFO [RS:2;jenkins-hbase4:41005] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-14 07:03:19,090 INFO [RS:0;jenkins-hbase4:35941] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-14 07:03:19,090 INFO [RS:2;jenkins-hbase4:41005] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-14 07:03:19,090 DEBUG [RS:0;jenkins-hbase4:35941] regionserver.HRegionServer(1478): Online Regions={e8c7a8a714ce5b83c0178f59f5b781c8=hbase:acl,,1694674859583.e8c7a8a714ce5b83c0178f59f5b781c8.} 2023-09-14 07:03:19,090 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1694674859583.e8c7a8a714ce5b83c0178f59f5b781c8. 2023-09-14 07:03:19,089 INFO [RS:1;jenkins-hbase4:37703] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-14 07:03:19,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1694674859583.e8c7a8a714ce5b83c0178f59f5b781c8. 2023-09-14 07:03:19,090 INFO [RS:2;jenkins-hbase4:41005] regionserver.HRegionServer(3305): Received CLOSE for 5e9aa8df1b0f6db9264d5b3afa60477d 2023-09-14 07:03:19,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1694674859583.e8c7a8a714ce5b83c0178f59f5b781c8. after waiting 0 ms 2023-09-14 07:03:19,090 INFO [RS:2;jenkins-hbase4:41005] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:03:19,090 INFO [RS:1;jenkins-hbase4:37703] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-14 07:03:19,090 DEBUG [RS:2;jenkins-hbase4:41005] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6d3ccca5 to 127.0.0.1:52295 2023-09-14 07:03:19,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1694674859583.e8c7a8a714ce5b83c0178f59f5b781c8. 2023-09-14 07:03:19,091 DEBUG [RS:2;jenkins-hbase4:41005] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 07:03:19,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5e9aa8df1b0f6db9264d5b3afa60477d, disabling compactions & flushes 2023-09-14 07:03:19,091 INFO [RS:1;jenkins-hbase4:37703] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-09-14 07:03:19,091 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1694674858832.5e9aa8df1b0f6db9264d5b3afa60477d. 2023-09-14 07:03:19,091 INFO [RS:2;jenkins-hbase4:41005] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-14 07:03:19,091 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing e8c7a8a714ce5b83c0178f59f5b781c8 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-09-14 07:03:19,091 DEBUG [RS:2;jenkins-hbase4:41005] regionserver.HRegionServer(1478): Online Regions={5e9aa8df1b0f6db9264d5b3afa60477d=hbase:namespace,,1694674858832.5e9aa8df1b0f6db9264d5b3afa60477d.} 2023-09-14 07:03:19,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1694674858832.5e9aa8df1b0f6db9264d5b3afa60477d. 2023-09-14 07:03:19,091 INFO [RS:1;jenkins-hbase4:37703] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-14 07:03:19,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1694674858832.5e9aa8df1b0f6db9264d5b3afa60477d. after waiting 0 ms 2023-09-14 07:03:19,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1694674858832.5e9aa8df1b0f6db9264d5b3afa60477d. 2023-09-14 07:03:19,092 DEBUG [RS:1;jenkins-hbase4:37703] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-09-14 07:03:19,092 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 5e9aa8df1b0f6db9264d5b3afa60477d 1/1 column families, dataSize=78 B heapSize=488 B 2023-09-14 07:03:19,092 DEBUG [RS:1;jenkins-hbase4:37703] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-09-14 07:03:19,092 DEBUG [RS:0;jenkins-hbase4:35941] regionserver.HRegionServer(1504): Waiting on e8c7a8a714ce5b83c0178f59f5b781c8 2023-09-14 07:03:19,092 DEBUG [RS:2;jenkins-hbase4:41005] regionserver.HRegionServer(1504): Waiting on 5e9aa8df1b0f6db9264d5b3afa60477d 2023-09-14 07:03:19,092 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-14 07:03:19,092 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-14 07:03:19,092 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-14 07:03:19,092 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-14 07:03:19,093 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-14 07:03:19,093 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-09-14 07:03:19,112 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/hbase/meta/1588230740/.tmp/info/ec7f48b788dd435daafd1640a3699a75 2023-09-14 07:03:19,114 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/hbase/acl/e8c7a8a714ce5b83c0178f59f5b781c8/.tmp/l/ea92ea9641344d1e94f1b4af7205169e 2023-09-14 07:03:19,117 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/hbase/namespace/5e9aa8df1b0f6db9264d5b3afa60477d/.tmp/info/c37ed3b69bfb43fa9274b0713f17079a 2023-09-14 07:03:19,117 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ec7f48b788dd435daafd1640a3699a75 2023-09-14 07:03:19,118 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-14 07:03:19,118 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-14 07:03:19,119 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-14 07:03:19,126 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ea92ea9641344d1e94f1b4af7205169e 2023-09-14 07:03:19,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/hbase/namespace/5e9aa8df1b0f6db9264d5b3afa60477d/.tmp/info/c37ed3b69bfb43fa9274b0713f17079a as hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/hbase/namespace/5e9aa8df1b0f6db9264d5b3afa60477d/info/c37ed3b69bfb43fa9274b0713f17079a 2023-09-14 07:03:19,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/hbase/acl/e8c7a8a714ce5b83c0178f59f5b781c8/.tmp/l/ea92ea9641344d1e94f1b4af7205169e as hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/hbase/acl/e8c7a8a714ce5b83c0178f59f5b781c8/l/ea92ea9641344d1e94f1b4af7205169e 2023-09-14 07:03:19,133 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/hbase/namespace/5e9aa8df1b0f6db9264d5b3afa60477d/info/c37ed3b69bfb43fa9274b0713f17079a, entries=2, sequenceid=6, filesize=4.8 K 2023-09-14 07:03:19,133 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ea92ea9641344d1e94f1b4af7205169e 2023-09-14 07:03:19,133 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/hbase/acl/e8c7a8a714ce5b83c0178f59f5b781c8/l/ea92ea9641344d1e94f1b4af7205169e, entries=7, sequenceid=18, filesize=5.2 K 2023-09-14 07:03:19,134 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 5e9aa8df1b0f6db9264d5b3afa60477d in 42ms, sequenceid=6, compaction requested=false 2023-09-14 07:03:19,140 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for e8c7a8a714ce5b83c0178f59f5b781c8 in 49ms, sequenceid=18, compaction requested=false 2023-09-14 07:03:19,147 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/hbase/meta/1588230740/.tmp/rep_barrier/8fb6c615826948ebbf096ce3074dcd9b 2023-09-14 07:03:19,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/hbase/acl/e8c7a8a714ce5b83c0178f59f5b781c8/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-09-14 07:03:19,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/hbase/namespace/5e9aa8df1b0f6db9264d5b3afa60477d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-14 07:03:19,150 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-14 07:03:19,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-14 07:03:19,151 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1694674858832.5e9aa8df1b0f6db9264d5b3afa60477d. 2023-09-14 07:03:19,151 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1694674859583.e8c7a8a714ce5b83c0178f59f5b781c8. 2023-09-14 07:03:19,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e8c7a8a714ce5b83c0178f59f5b781c8: 2023-09-14 07:03:19,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5e9aa8df1b0f6db9264d5b3afa60477d: 2023-09-14 07:03:19,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1694674858832.5e9aa8df1b0f6db9264d5b3afa60477d. 2023-09-14 07:03:19,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1694674859583.e8c7a8a714ce5b83c0178f59f5b781c8. 2023-09-14 07:03:19,152 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8fb6c615826948ebbf096ce3074dcd9b 2023-09-14 07:03:19,163 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/hbase/meta/1588230740/.tmp/table/97ff72dbc2bc460d8c53f6fdbd99e003 2023-09-14 07:03:19,167 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 97ff72dbc2bc460d8c53f6fdbd99e003 2023-09-14 07:03:19,167 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/hbase/meta/1588230740/.tmp/info/ec7f48b788dd435daafd1640a3699a75 as hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/hbase/meta/1588230740/info/ec7f48b788dd435daafd1640a3699a75 2023-09-14 07:03:19,171 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ec7f48b788dd435daafd1640a3699a75 2023-09-14 07:03:19,171 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/hbase/meta/1588230740/info/ec7f48b788dd435daafd1640a3699a75, entries=48, sequenceid=131, filesize=10.3 K 2023-09-14 07:03:19,172 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/hbase/meta/1588230740/.tmp/rep_barrier/8fb6c615826948ebbf096ce3074dcd9b as hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/hbase/meta/1588230740/rep_barrier/8fb6c615826948ebbf096ce3074dcd9b 2023-09-14 07:03:19,175 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8fb6c615826948ebbf096ce3074dcd9b 2023-09-14 07:03:19,175 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/hbase/meta/1588230740/rep_barrier/8fb6c615826948ebbf096ce3074dcd9b, entries=13, sequenceid=131, filesize=6.4 K 2023-09-14 07:03:19,176 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/hbase/meta/1588230740/.tmp/table/97ff72dbc2bc460d8c53f6fdbd99e003 as hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/hbase/meta/1588230740/table/97ff72dbc2bc460d8c53f6fdbd99e003 2023-09-14 07:03:19,180 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 97ff72dbc2bc460d8c53f6fdbd99e003 2023-09-14 07:03:19,180 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/hbase/meta/1588230740/table/97ff72dbc2bc460d8c53f6fdbd99e003, entries=24, sequenceid=131, filesize=6.9 K 2023-09-14 07:03:19,181 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 88ms, sequenceid=131, compaction requested=false 2023-09-14 07:03:19,190 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-09-14 07:03:19,191 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-14 07:03:19,191 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-14 07:03:19,191 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-14 07:03:19,191 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-14 07:03:19,192 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-09-14 07:03:19,230 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-09-14 07:03:19,230 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-09-14 07:03:19,239 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-09-14 07:03:19,239 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-09-14 07:03:19,239 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-09-14 07:03:19,239 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-09-14 07:03:19,292 INFO [RS:1;jenkins-hbase4:37703] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,37703,1694674856695; all regions closed. 2023-09-14 07:03:19,292 INFO [RS:2;jenkins-hbase4:41005] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,41005,1694674856735; all regions closed. 2023-09-14 07:03:19,292 INFO [RS:0;jenkins-hbase4:35941] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,35941,1694674856649; all regions closed. 2023-09-14 07:03:19,305 DEBUG [RS:2;jenkins-hbase4:41005] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/oldWALs 2023-09-14 07:03:19,305 INFO [RS:2;jenkins-hbase4:41005] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41005%2C1694674856735:(num 1694674858401) 2023-09-14 07:03:19,305 DEBUG [RS:2;jenkins-hbase4:41005] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 07:03:19,305 DEBUG [RS:0;jenkins-hbase4:35941] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/oldWALs 2023-09-14 07:03:19,305 DEBUG [RS:1;jenkins-hbase4:37703] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/oldWALs 2023-09-14 07:03:19,305 INFO [RS:1;jenkins-hbase4:37703] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37703%2C1694674856695.meta:.meta(num 1694674858551) 2023-09-14 07:03:19,305 INFO [RS:2;jenkins-hbase4:41005] regionserver.LeaseManager(133): Closed leases 2023-09-14 07:03:19,305 INFO [RS:0;jenkins-hbase4:35941] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35941%2C1694674856649:(num 1694674858401) 2023-09-14 07:03:19,306 DEBUG [RS:0;jenkins-hbase4:35941] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 07:03:19,306 INFO [RS:0;jenkins-hbase4:35941] regionserver.LeaseManager(133): Closed leases 2023-09-14 07:03:19,306 INFO [RS:2;jenkins-hbase4:41005] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-14 07:03:19,306 INFO [RS:2;jenkins-hbase4:41005] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-14 07:03:19,306 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-14 07:03:19,306 INFO [RS:2;jenkins-hbase4:41005] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-14 07:03:19,306 INFO [RS:2;jenkins-hbase4:41005] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-14 07:03:19,306 INFO [RS:0;jenkins-hbase4:35941] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-14 07:03:19,307 INFO [RS:0;jenkins-hbase4:35941] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-14 07:03:19,307 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-14 07:03:19,307 INFO [RS:0;jenkins-hbase4:35941] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-14 07:03:19,307 INFO [RS:0;jenkins-hbase4:35941] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-14 07:03:19,308 INFO [RS:2;jenkins-hbase4:41005] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41005 2023-09-14 07:03:19,309 INFO [RS:0;jenkins-hbase4:35941] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35941 2023-09-14 07:03:19,315 DEBUG [RS:1;jenkins-hbase4:37703] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/oldWALs 2023-09-14 07:03:19,315 INFO [RS:1;jenkins-hbase4:37703] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37703%2C1694674856695:(num 1694674858401) 2023-09-14 07:03:19,315 DEBUG [RS:1;jenkins-hbase4:37703] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 07:03:19,315 INFO [RS:1;jenkins-hbase4:37703] regionserver.LeaseManager(133): Closed leases 2023-09-14 07:03:19,315 INFO [RS:1;jenkins-hbase4:37703] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-14 07:03:19,315 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-14 07:03:19,316 INFO [RS:1;jenkins-hbase4:37703] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37703 2023-09-14 07:03:19,317 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:03:19,317 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:03:19,317 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-14 07:03:19,317 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35941,1694674856649 2023-09-14 07:03:19,317 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-14 07:03:19,317 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-14 07:03:19,317 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-14 07:03:19,317 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:03:19,317 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:03:19,318 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41005,1694674856735 2023-09-14 07:03:19,319 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:03:19,319 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35941,1694674856649] 2023-09-14 07:03:19,319 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:03:19,319 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37703,1694674856695 2023-09-14 07:03:19,319 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35941,1694674856649; numProcessing=1 2023-09-14 07:03:19,320 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35941,1694674856649 already deleted, retry=false 2023-09-14 07:03:19,321 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35941,1694674856649 expired; onlineServers=2 2023-09-14 07:03:19,321 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41005,1694674856735] 2023-09-14 07:03:19,321 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41005,1694674856735; numProcessing=2 2023-09-14 07:03:19,322 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41005,1694674856735 already deleted, retry=false 2023-09-14 07:03:19,322 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41005,1694674856735 expired; onlineServers=1 2023-09-14 07:03:19,322 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37703,1694674856695] 2023-09-14 07:03:19,322 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37703,1694674856695; numProcessing=3 2023-09-14 07:03:19,324 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37703,1694674856695 already deleted, retry=false 2023-09-14 07:03:19,324 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37703,1694674856695 expired; onlineServers=0 2023-09-14 07:03:19,324 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,33055,1694674855392' ***** 2023-09-14 07:03:19,324 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-09-14 07:03:19,324 DEBUG [M:0;jenkins-hbase4:33055] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@587a0c8a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-14 07:03:19,324 INFO [M:0;jenkins-hbase4:33055] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,33055,1694674855392 2023-09-14 07:03:19,324 INFO [M:0;jenkins-hbase4:33055] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,33055,1694674855392; all regions closed. 2023-09-14 07:03:19,324 DEBUG [M:0;jenkins-hbase4:33055] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 07:03:19,324 DEBUG [M:0;jenkins-hbase4:33055] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-09-14 07:03:19,324 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-09-14 07:03:19,324 DEBUG [M:0;jenkins-hbase4:33055] cleaner.HFileCleaner(317): Stopping file delete threads 2023-09-14 07:03:19,324 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1694674858032] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1694674858032,5,FailOnTimeoutGroup] 2023-09-14 07:03:19,324 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1694674858032] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1694674858032,5,FailOnTimeoutGroup] 2023-09-14 07:03:19,324 INFO [M:0;jenkins-hbase4:33055] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-09-14 07:03:19,325 INFO [M:0;jenkins-hbase4:33055] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-09-14 07:03:19,325 INFO [M:0;jenkins-hbase4:33055] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-09-14 07:03:19,325 DEBUG [M:0;jenkins-hbase4:33055] master.HMaster(1512): Stopping service threads 2023-09-14 07:03:19,325 INFO [M:0;jenkins-hbase4:33055] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-09-14 07:03:19,325 ERROR [M:0;jenkins-hbase4:33055] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-14,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-09-14 07:03:19,326 INFO [M:0;jenkins-hbase4:33055] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-09-14 07:03:19,326 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-09-14 07:03:19,326 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-09-14 07:03:19,326 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-14 07:03:19,326 DEBUG [M:0;jenkins-hbase4:33055] zookeeper.ZKUtil(398): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-09-14 07:03:19,326 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-14 07:03:19,326 WARN [M:0;jenkins-hbase4:33055] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-09-14 07:03:19,326 INFO [M:0;jenkins-hbase4:33055] assignment.AssignmentManager(315): Stopping assignment manager 2023-09-14 07:03:19,326 INFO [M:0;jenkins-hbase4:33055] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-09-14 07:03:19,327 DEBUG [M:0;jenkins-hbase4:33055] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-14 07:03:19,327 INFO [M:0;jenkins-hbase4:33055] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-14 07:03:19,327 DEBUG [M:0;jenkins-hbase4:33055] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-14 07:03:19,327 DEBUG [M:0;jenkins-hbase4:33055] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-14 07:03:19,327 DEBUG [M:0;jenkins-hbase4:33055] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-14 07:03:19,327 INFO [M:0;jenkins-hbase4:33055] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.89 KB heapSize=452.16 KB 2023-09-14 07:03:19,339 INFO [M:0;jenkins-hbase4:33055] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.89 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/e57f9e76456d40dcb34fe79ed5d0701e 2023-09-14 07:03:19,343 INFO [M:0;jenkins-hbase4:33055] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e57f9e76456d40dcb34fe79ed5d0701e 2023-09-14 07:03:19,344 DEBUG [M:0;jenkins-hbase4:33055] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/e57f9e76456d40dcb34fe79ed5d0701e as hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/e57f9e76456d40dcb34fe79ed5d0701e 2023-09-14 07:03:19,349 INFO [M:0;jenkins-hbase4:33055] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e57f9e76456d40dcb34fe79ed5d0701e 2023-09-14 07:03:19,349 INFO [M:0;jenkins-hbase4:33055] regionserver.HStore(1080): Added hdfs://localhost:44283/user/jenkins/test-data/398fd91e-7e2f-5bdf-5f2a-29c13ca0bd04/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/e57f9e76456d40dcb34fe79ed5d0701e, entries=119, sequenceid=899, filesize=28.7 K 2023-09-14 07:03:19,350 INFO [M:0;jenkins-hbase4:33055] regionserver.HRegion(2948): Finished flush of dataSize ~375.89 KB/384916, heapSize ~452.14 KB/462992, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 23ms, sequenceid=899, compaction requested=false 2023-09-14 07:03:19,352 INFO [M:0;jenkins-hbase4:33055] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-14 07:03:19,352 DEBUG [M:0;jenkins-hbase4:33055] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-14 07:03:19,356 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-14 07:03:19,356 INFO [M:0;jenkins-hbase4:33055] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-09-14 07:03:19,356 INFO [M:0;jenkins-hbase4:33055] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33055 2023-09-14 07:03:19,358 DEBUG [M:0;jenkins-hbase4:33055] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,33055,1694674855392 already deleted, retry=false 2023-09-14 07:03:19,420 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-14 07:03:19,420 INFO [RS:0;jenkins-hbase4:35941] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,35941,1694674856649; zookeeper connection closed. 2023-09-14 07:03:19,420 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:35941-0x100a93d59ec0001, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-14 07:03:19,421 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@33e204ef] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@33e204ef 2023-09-14 07:03:19,520 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-14 07:03:19,520 INFO [M:0;jenkins-hbase4:33055] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,33055,1694674855392; zookeeper connection closed. 2023-09-14 07:03:19,520 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): master:33055-0x100a93d59ec0000, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-14 07:03:19,621 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-14 07:03:19,621 INFO [RS:1;jenkins-hbase4:37703] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,37703,1694674856695; zookeeper connection closed. 2023-09-14 07:03:19,621 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:37703-0x100a93d59ec0002, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-14 07:03:19,621 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@61b3e68f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@61b3e68f 2023-09-14 07:03:19,721 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-14 07:03:19,721 INFO [RS:2;jenkins-hbase4:41005] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,41005,1694674856735; zookeeper connection closed. 2023-09-14 07:03:19,721 DEBUG [Listener at localhost/35097-EventThread] zookeeper.ZKWatcher(600): regionserver:41005-0x100a93d59ec0003, quorum=127.0.0.1:52295, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-14 07:03:19,721 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@735a48a6] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@735a48a6 2023-09-14 07:03:19,722 INFO [Listener at jenkins-hbase4.apache.org/40843] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-09-14 07:03:19,722 WARN [Listener at jenkins-hbase4.apache.org/40843] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-14 07:03:19,724 INFO [Listener at jenkins-hbase4.apache.org/40843] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-14 07:03:19,827 WARN [BP-1664923587-172.31.14.131-1694674851730 heartbeating to localhost/127.0.0.1:44283] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-14 07:03:19,827 WARN [BP-1664923587-172.31.14.131-1694674851730 heartbeating to localhost/127.0.0.1:44283] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1664923587-172.31.14.131-1694674851730 (Datanode Uuid e52718cd-89c8-4f02-abb7-65322675f931) service to localhost/127.0.0.1:44283 2023-09-14 07:03:19,829 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/cluster_e41a8b39-3adf-15a8-f202-16f92e78dec5/dfs/data/data5/current/BP-1664923587-172.31.14.131-1694674851730] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-14 07:03:19,829 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/cluster_e41a8b39-3adf-15a8-f202-16f92e78dec5/dfs/data/data6/current/BP-1664923587-172.31.14.131-1694674851730] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-14 07:03:19,830 WARN [Listener at jenkins-hbase4.apache.org/40843] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-14 07:03:19,832 INFO [Listener at jenkins-hbase4.apache.org/40843] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-14 07:03:19,936 WARN [BP-1664923587-172.31.14.131-1694674851730 heartbeating to localhost/127.0.0.1:44283] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-14 07:03:19,936 WARN [BP-1664923587-172.31.14.131-1694674851730 heartbeating to localhost/127.0.0.1:44283] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1664923587-172.31.14.131-1694674851730 (Datanode Uuid 4a706415-c677-4b58-a286-735f266e4884) service to localhost/127.0.0.1:44283 2023-09-14 07:03:19,936 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/cluster_e41a8b39-3adf-15a8-f202-16f92e78dec5/dfs/data/data3/current/BP-1664923587-172.31.14.131-1694674851730] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-14 07:03:19,937 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/cluster_e41a8b39-3adf-15a8-f202-16f92e78dec5/dfs/data/data4/current/BP-1664923587-172.31.14.131-1694674851730] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-14 07:03:19,937 WARN [Listener at jenkins-hbase4.apache.org/40843] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-14 07:03:19,939 INFO [Listener at jenkins-hbase4.apache.org/40843] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-14 07:03:20,042 WARN [BP-1664923587-172.31.14.131-1694674851730 heartbeating to localhost/127.0.0.1:44283] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-14 07:03:20,042 WARN [BP-1664923587-172.31.14.131-1694674851730 heartbeating to localhost/127.0.0.1:44283] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1664923587-172.31.14.131-1694674851730 (Datanode Uuid 8278a81d-35fb-4209-8cf7-8541ee337911) service to localhost/127.0.0.1:44283 2023-09-14 07:03:20,042 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/cluster_e41a8b39-3adf-15a8-f202-16f92e78dec5/dfs/data/data1/current/BP-1664923587-172.31.14.131-1694674851730] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-14 07:03:20,043 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948e5628-f1dc-b01a-d6d9-d2e6a7bd9d62/cluster_e41a8b39-3adf-15a8-f202-16f92e78dec5/dfs/data/data2/current/BP-1664923587-172.31.14.131-1694674851730] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-14 07:03:20,063 INFO [Listener at jenkins-hbase4.apache.org/40843] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-14 07:03:20,188 INFO [Listener at jenkins-hbase4.apache.org/40843] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-09-14 07:03:20,282 INFO [Listener at jenkins-hbase4.apache.org/40843] hbase.HBaseTestingUtility(1293): Minicluster is down