2023-07-14 09:12:22,079 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-14 09:12:22,343 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9 2023-07-14 09:12:22,343 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-14 09:12:22,344 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-14 09:12:22,390 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-14 09:12:22,631 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-14 09:12:22,632 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/cluster_57fe12f0-0229-b77c-f9b6-f833c5ee750b, deleteOnExit=true 2023-07-14 09:12:22,632 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-14 09:12:22,632 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/test.cache.data in system properties and HBase conf 2023-07-14 09:12:22,633 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/hadoop.tmp.dir in system properties and HBase conf 2023-07-14 09:12:22,633 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/hadoop.log.dir in system properties and HBase conf 2023-07-14 09:12:22,634 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-14 09:12:22,634 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-14 09:12:22,634 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-14 09:12:22,975 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-14 09:12:22,980 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-14 09:12:22,980 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-14 09:12:22,981 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-14 09:12:22,981 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-14 09:12:22,982 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-14 09:12:22,982 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-14 09:12:22,983 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-14 09:12:22,983 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-14 09:12:22,983 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-14 09:12:22,984 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/nfs.dump.dir in system properties and HBase conf 2023-07-14 09:12:22,984 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/java.io.tmpdir in system properties and HBase conf 2023-07-14 09:12:22,984 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-14 09:12:22,985 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-14 09:12:22,985 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-14 09:12:23,600 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-14 09:12:23,604 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-14 09:12:23,895 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-14 09:12:24,071 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-14 09:12:24,090 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 09:12:24,126 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 09:12:24,162 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/java.io.tmpdir/Jetty_localhost_37253_hdfs____.tzbqay/webapp 2023-07-14 09:12:24,316 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37253 2023-07-14 09:12:24,363 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-14 09:12:24,363 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-14 09:12:24,971 WARN [Listener at localhost/43771] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-14 09:12:25,075 WARN [Listener at localhost/43771] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-14 09:12:25,096 WARN [Listener at localhost/43771] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 09:12:25,103 INFO [Listener at localhost/43771] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 09:12:25,111 INFO [Listener at localhost/43771] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/java.io.tmpdir/Jetty_localhost_36623_datanode____.cm9mcl/webapp 2023-07-14 09:12:25,222 INFO [Listener at localhost/43771] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36623 2023-07-14 09:12:25,820 WARN [Listener at localhost/38439] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-14 09:12:25,867 WARN [Listener at localhost/38439] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-14 09:12:25,877 WARN [Listener at localhost/38439] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 09:12:25,880 INFO [Listener at localhost/38439] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 09:12:25,892 INFO [Listener at localhost/38439] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/java.io.tmpdir/Jetty_localhost_36301_datanode____a1j9ug/webapp 2023-07-14 09:12:26,043 INFO [Listener at localhost/38439] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36301 2023-07-14 09:12:26,057 WARN [Listener at localhost/33591] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-14 09:12:26,081 WARN [Listener at localhost/33591] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-14 09:12:26,086 WARN [Listener at localhost/33591] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 09:12:26,088 INFO [Listener at localhost/33591] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 09:12:26,096 INFO [Listener at localhost/33591] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/java.io.tmpdir/Jetty_localhost_39495_datanode____.dzdmgf/webapp 2023-07-14 09:12:26,278 INFO [Listener at localhost/33591] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39495 2023-07-14 09:12:26,309 WARN [Listener at localhost/40607] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-14 09:12:26,648 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x13387bc1f279aeaa: Processing first storage report for DS-80a6a851-c424-4858-adbb-de8f65a4225d from datanode 84c52bd0-90e3-4ce7-9095-0e067400d07d 2023-07-14 09:12:26,650 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x13387bc1f279aeaa: from storage DS-80a6a851-c424-4858-adbb-de8f65a4225d node DatanodeRegistration(127.0.0.1:35937, datanodeUuid=84c52bd0-90e3-4ce7-9095-0e067400d07d, infoPort=36923, infoSecurePort=0, ipcPort=38439, storageInfo=lv=-57;cid=testClusterID;nsid=351299155;c=1689325943675), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-14 09:12:26,650 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x13387bc1f279aeaa: Processing first storage report for DS-793e500c-9aea-442d-af7f-98888ce5c148 from datanode 84c52bd0-90e3-4ce7-9095-0e067400d07d 2023-07-14 09:12:26,650 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x13387bc1f279aeaa: from storage DS-793e500c-9aea-442d-af7f-98888ce5c148 node DatanodeRegistration(127.0.0.1:35937, datanodeUuid=84c52bd0-90e3-4ce7-9095-0e067400d07d, infoPort=36923, infoSecurePort=0, ipcPort=38439, storageInfo=lv=-57;cid=testClusterID;nsid=351299155;c=1689325943675), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-14 09:12:26,656 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc956dd5d0f82756: Processing first storage report for DS-0af70be0-51b0-4d61-825b-706e3627b856 from datanode d7547804-6fb7-466e-b8b5-2fafb586c1f0 2023-07-14 09:12:26,656 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc956dd5d0f82756: from storage DS-0af70be0-51b0-4d61-825b-706e3627b856 node DatanodeRegistration(127.0.0.1:42081, datanodeUuid=d7547804-6fb7-466e-b8b5-2fafb586c1f0, infoPort=39827, infoSecurePort=0, ipcPort=33591, storageInfo=lv=-57;cid=testClusterID;nsid=351299155;c=1689325943675), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-14 09:12:26,656 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc956dd5d0f82756: Processing first storage report for DS-883dce8f-be57-4a23-8269-87263581bb1e from datanode d7547804-6fb7-466e-b8b5-2fafb586c1f0 2023-07-14 09:12:26,656 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc956dd5d0f82756: from storage DS-883dce8f-be57-4a23-8269-87263581bb1e node DatanodeRegistration(127.0.0.1:42081, datanodeUuid=d7547804-6fb7-466e-b8b5-2fafb586c1f0, infoPort=39827, infoSecurePort=0, ipcPort=33591, storageInfo=lv=-57;cid=testClusterID;nsid=351299155;c=1689325943675), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-14 09:12:26,658 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xccba2e7cd25d03c9: Processing first storage report for DS-2f016ab3-dae5-449c-b732-b039b567365c from datanode bda4a42e-6e57-4416-82cd-c8e3023a91a2 2023-07-14 09:12:26,658 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xccba2e7cd25d03c9: from storage DS-2f016ab3-dae5-449c-b732-b039b567365c node DatanodeRegistration(127.0.0.1:46091, datanodeUuid=bda4a42e-6e57-4416-82cd-c8e3023a91a2, infoPort=43535, infoSecurePort=0, ipcPort=40607, storageInfo=lv=-57;cid=testClusterID;nsid=351299155;c=1689325943675), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-14 09:12:26,659 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xccba2e7cd25d03c9: Processing first storage report for DS-3bac7bf9-013f-4891-a857-9a229946eb38 from datanode bda4a42e-6e57-4416-82cd-c8e3023a91a2 2023-07-14 09:12:26,659 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xccba2e7cd25d03c9: from storage DS-3bac7bf9-013f-4891-a857-9a229946eb38 node DatanodeRegistration(127.0.0.1:46091, datanodeUuid=bda4a42e-6e57-4416-82cd-c8e3023a91a2, infoPort=43535, infoSecurePort=0, ipcPort=40607, storageInfo=lv=-57;cid=testClusterID;nsid=351299155;c=1689325943675), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-14 09:12:26,955 DEBUG [Listener at localhost/40607] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9 2023-07-14 09:12:27,068 INFO [Listener at localhost/40607] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/cluster_57fe12f0-0229-b77c-f9b6-f833c5ee750b/zookeeper_0, clientPort=59920, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/cluster_57fe12f0-0229-b77c-f9b6-f833c5ee750b/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/cluster_57fe12f0-0229-b77c-f9b6-f833c5ee750b/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-14 09:12:27,089 INFO [Listener at localhost/40607] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=59920 2023-07-14 09:12:27,101 INFO [Listener at localhost/40607] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 09:12:27,104 INFO [Listener at localhost/40607] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 09:12:27,818 INFO [Listener at localhost/40607] util.FSUtils(471): Created version file at hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8 with version=8 2023-07-14 09:12:27,818 INFO [Listener at localhost/40607] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/hbase-staging 2023-07-14 09:12:28,239 INFO [Listener at localhost/40607] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-14 09:12:28,910 INFO [Listener at localhost/40607] client.ConnectionUtils(127): master/jenkins-hbase9:0 server-side Connection retries=45 2023-07-14 09:12:28,957 INFO [Listener at localhost/40607] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 09:12:28,958 INFO [Listener at localhost/40607] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-14 09:12:28,958 INFO [Listener at localhost/40607] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-14 09:12:28,959 INFO [Listener at localhost/40607] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 09:12:28,959 INFO [Listener at localhost/40607] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-14 09:12:29,168 INFO [Listener at localhost/40607] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-14 09:12:29,280 DEBUG [Listener at localhost/40607] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-14 09:12:29,417 INFO [Listener at localhost/40607] ipc.NettyRpcServer(120): Bind to /172.31.2.10:41733 2023-07-14 09:12:29,431 INFO [Listener at localhost/40607] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 09:12:29,433 INFO [Listener at localhost/40607] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 09:12:29,461 INFO [Listener at localhost/40607] zookeeper.RecoverableZooKeeper(93): Process identifier=master:41733 connecting to ZooKeeper ensemble=127.0.0.1:59920 2023-07-14 09:12:29,524 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:417330x0, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-14 09:12:29,529 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:41733-0x101630d0c4a0000 connected 2023-07-14 09:12:29,586 DEBUG [Listener at localhost/40607] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-14 09:12:29,588 DEBUG [Listener at localhost/40607] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 09:12:29,606 DEBUG [Listener at localhost/40607] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-14 09:12:29,634 DEBUG [Listener at localhost/40607] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41733 2023-07-14 09:12:29,639 DEBUG [Listener at localhost/40607] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41733 2023-07-14 09:12:29,641 DEBUG [Listener at localhost/40607] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41733 2023-07-14 09:12:29,648 DEBUG [Listener at localhost/40607] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41733 2023-07-14 09:12:29,648 DEBUG [Listener at localhost/40607] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41733 2023-07-14 09:12:29,656 INFO [Listener at localhost/40607] master.HMaster(444): hbase.rootdir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8, hbase.cluster.distributed=false 2023-07-14 09:12:29,766 INFO [Listener at localhost/40607] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-07-14 09:12:29,766 INFO [Listener at localhost/40607] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 09:12:29,767 INFO [Listener at localhost/40607] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-14 09:12:29,767 INFO [Listener at localhost/40607] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-14 09:12:29,767 INFO [Listener at localhost/40607] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 09:12:29,767 INFO [Listener at localhost/40607] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-14 09:12:29,774 INFO [Listener at localhost/40607] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-14 09:12:29,779 INFO [Listener at localhost/40607] ipc.NettyRpcServer(120): Bind to /172.31.2.10:37313 2023-07-14 09:12:29,782 INFO [Listener at localhost/40607] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-14 09:12:29,794 INFO [Listener at localhost/40607] mob.MobFileCache(124): MobFileCache disabled 2023-07-14 09:12:29,795 INFO [Listener at localhost/40607] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 09:12:29,798 INFO [Listener at localhost/40607] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 09:12:29,826 INFO [Listener at localhost/40607] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37313 connecting to ZooKeeper ensemble=127.0.0.1:59920 2023-07-14 09:12:29,853 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:373130x0, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-14 09:12:29,853 DEBUG [Listener at localhost/40607] zookeeper.ZKUtil(164): regionserver:373130x0, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-14 09:12:29,856 DEBUG [Listener at localhost/40607] zookeeper.ZKUtil(164): regionserver:373130x0, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 09:12:29,857 DEBUG [Listener at localhost/40607] zookeeper.ZKUtil(164): regionserver:373130x0, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-14 09:12:29,865 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:37313-0x101630d0c4a0001 connected 2023-07-14 09:12:29,880 DEBUG [Listener at localhost/40607] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37313 2023-07-14 09:12:29,887 DEBUG [Listener at localhost/40607] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37313 2023-07-14 09:12:29,889 DEBUG [Listener at localhost/40607] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37313 2023-07-14 09:12:29,895 DEBUG [Listener at localhost/40607] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37313 2023-07-14 09:12:29,897 DEBUG [Listener at localhost/40607] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37313 2023-07-14 09:12:29,914 INFO [Listener at localhost/40607] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-07-14 09:12:29,914 INFO [Listener at localhost/40607] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 09:12:29,914 INFO [Listener at localhost/40607] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-14 09:12:29,924 INFO [Listener at localhost/40607] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-14 09:12:29,924 INFO [Listener at localhost/40607] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 09:12:29,924 INFO [Listener at localhost/40607] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-14 09:12:29,924 INFO [Listener at localhost/40607] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-14 09:12:29,931 INFO [Listener at localhost/40607] ipc.NettyRpcServer(120): Bind to /172.31.2.10:45899 2023-07-14 09:12:29,932 INFO [Listener at localhost/40607] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-14 09:12:29,943 INFO [Listener at localhost/40607] mob.MobFileCache(124): MobFileCache disabled 2023-07-14 09:12:29,950 INFO [Listener at localhost/40607] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 09:12:29,952 INFO [Listener at localhost/40607] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 09:12:29,954 INFO [Listener at localhost/40607] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45899 connecting to ZooKeeper ensemble=127.0.0.1:59920 2023-07-14 09:12:29,972 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:458990x0, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-14 09:12:29,978 DEBUG [Listener at localhost/40607] zookeeper.ZKUtil(164): regionserver:458990x0, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-14 09:12:29,980 DEBUG [Listener at localhost/40607] zookeeper.ZKUtil(164): regionserver:458990x0, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 09:12:29,981 DEBUG [Listener at localhost/40607] zookeeper.ZKUtil(164): regionserver:458990x0, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-14 09:12:30,003 DEBUG [Listener at localhost/40607] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45899 2023-07-14 09:12:30,005 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:45899-0x101630d0c4a0002 connected 2023-07-14 09:12:30,013 DEBUG [Listener at localhost/40607] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45899 2023-07-14 09:12:30,015 DEBUG [Listener at localhost/40607] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45899 2023-07-14 09:12:30,018 DEBUG [Listener at localhost/40607] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45899 2023-07-14 09:12:30,021 DEBUG [Listener at localhost/40607] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45899 2023-07-14 09:12:30,035 INFO [Listener at localhost/40607] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-07-14 09:12:30,036 INFO [Listener at localhost/40607] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 09:12:30,036 INFO [Listener at localhost/40607] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-14 09:12:30,036 INFO [Listener at localhost/40607] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-14 09:12:30,036 INFO [Listener at localhost/40607] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 09:12:30,036 INFO [Listener at localhost/40607] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-14 09:12:30,037 INFO [Listener at localhost/40607] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-14 09:12:30,044 INFO [Listener at localhost/40607] ipc.NettyRpcServer(120): Bind to /172.31.2.10:41875 2023-07-14 09:12:30,044 INFO [Listener at localhost/40607] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-14 09:12:30,050 INFO [Listener at localhost/40607] mob.MobFileCache(124): MobFileCache disabled 2023-07-14 09:12:30,051 INFO [Listener at localhost/40607] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 09:12:30,053 INFO [Listener at localhost/40607] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 09:12:30,055 INFO [Listener at localhost/40607] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41875 connecting to ZooKeeper ensemble=127.0.0.1:59920 2023-07-14 09:12:30,066 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:418750x0, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-14 09:12:30,067 DEBUG [Listener at localhost/40607] zookeeper.ZKUtil(164): regionserver:418750x0, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-14 09:12:30,068 DEBUG [Listener at localhost/40607] zookeeper.ZKUtil(164): regionserver:418750x0, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 09:12:30,069 DEBUG [Listener at localhost/40607] zookeeper.ZKUtil(164): regionserver:418750x0, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-14 09:12:30,085 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:41875-0x101630d0c4a0003 connected 2023-07-14 09:12:30,089 DEBUG [Listener at localhost/40607] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41875 2023-07-14 09:12:30,090 DEBUG [Listener at localhost/40607] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41875 2023-07-14 09:12:30,094 DEBUG [Listener at localhost/40607] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41875 2023-07-14 09:12:30,098 DEBUG [Listener at localhost/40607] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41875 2023-07-14 09:12:30,098 DEBUG [Listener at localhost/40607] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41875 2023-07-14 09:12:30,100 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase9.apache.org,41733,1689325948012 2023-07-14 09:12:30,110 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-14 09:12:30,112 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase9.apache.org,41733,1689325948012 2023-07-14 09:12:30,144 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-14 09:12:30,144 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-14 09:12:30,145 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-14 09:12:30,144 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-14 09:12:30,145 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 09:12:30,149 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-14 09:12:30,150 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-14 09:12:30,156 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase9.apache.org,41733,1689325948012 from backup master directory 2023-07-14 09:12:30,161 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase9.apache.org,41733,1689325948012 2023-07-14 09:12:30,161 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-14 09:12:30,163 WARN [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-14 09:12:30,163 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase9.apache.org,41733,1689325948012 2023-07-14 09:12:30,167 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-14 09:12:30,169 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-14 09:12:30,327 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/hbase.id with ID: 05c01ca0-07af-4e88-b391-d352bc03767d 2023-07-14 09:12:30,378 INFO [master/jenkins-hbase9:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 09:12:30,398 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 09:12:30,496 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x195ec3e9 to 127.0.0.1:59920 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:12:30,570 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2505871c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:12:30,611 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-14 09:12:30,614 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-14 09:12:30,640 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-14 09:12:30,640 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-14 09:12:30,643 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-14 09:12:30,656 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-14 09:12:30,658 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-14 09:12:30,712 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/MasterData/data/master/store-tmp 2023-07-14 09:12:30,816 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:12:30,816 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-14 09:12:30,816 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 09:12:30,817 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 09:12:30,817 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-14 09:12:30,817 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 09:12:30,817 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 09:12:30,817 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-14 09:12:30,819 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/MasterData/WALs/jenkins-hbase9.apache.org,41733,1689325948012 2023-07-14 09:12:30,851 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C41733%2C1689325948012, suffix=, logDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/MasterData/WALs/jenkins-hbase9.apache.org,41733,1689325948012, archiveDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/MasterData/oldWALs, maxLogs=10 2023-07-14 09:12:31,000 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42081,DS-0af70be0-51b0-4d61-825b-706e3627b856,DISK] 2023-07-14 09:12:31,005 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46091,DS-2f016ab3-dae5-449c-b732-b039b567365c,DISK] 2023-07-14 09:12:31,000 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35937,DS-80a6a851-c424-4858-adbb-de8f65a4225d,DISK] 2023-07-14 09:12:31,023 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-14 09:12:31,154 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/MasterData/WALs/jenkins-hbase9.apache.org,41733,1689325948012/jenkins-hbase9.apache.org%2C41733%2C1689325948012.1689325950865 2023-07-14 09:12:31,162 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42081,DS-0af70be0-51b0-4d61-825b-706e3627b856,DISK], DatanodeInfoWithStorage[127.0.0.1:46091,DS-2f016ab3-dae5-449c-b732-b039b567365c,DISK], DatanodeInfoWithStorage[127.0.0.1:35937,DS-80a6a851-c424-4858-adbb-de8f65a4225d,DISK]] 2023-07-14 09:12:31,162 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-14 09:12:31,163 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:12:31,168 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-14 09:12:31,169 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-14 09:12:31,290 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-14 09:12:31,302 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-14 09:12:31,348 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-14 09:12:31,372 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 09:12:31,380 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-14 09:12:31,382 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-14 09:12:31,418 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-14 09:12:31,424 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 09:12:31,426 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66552629, jitterRate=-0.008288547396659851}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 09:12:31,426 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-14 09:12:31,431 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-14 09:12:31,463 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-14 09:12:31,463 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-14 09:12:31,467 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-14 09:12:31,469 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-14 09:12:31,527 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 57 msec 2023-07-14 09:12:31,527 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-14 09:12:31,582 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-14 09:12:31,592 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-14 09:12:31,627 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-14 09:12:31,634 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-14 09:12:31,636 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-14 09:12:31,645 INFO [master/jenkins-hbase9:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-14 09:12:31,650 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-14 09:12:31,657 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 09:12:31,658 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-14 09:12:31,659 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-14 09:12:31,673 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-14 09:12:31,679 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-14 09:12:31,679 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-14 09:12:31,679 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-14 09:12:31,679 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 09:12:31,679 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-14 09:12:31,680 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase9.apache.org,41733,1689325948012, sessionid=0x101630d0c4a0000, setting cluster-up flag (Was=false) 2023-07-14 09:12:31,705 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 09:12:31,714 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-14 09:12:31,716 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,41733,1689325948012 2023-07-14 09:12:31,724 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 09:12:31,733 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-14 09:12:31,737 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,41733,1689325948012 2023-07-14 09:12:31,744 WARN [master/jenkins-hbase9:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/.tmp 2023-07-14 09:12:31,811 INFO [RS:0;jenkins-hbase9:37313] regionserver.HRegionServer(951): ClusterId : 05c01ca0-07af-4e88-b391-d352bc03767d 2023-07-14 09:12:31,824 INFO [RS:1;jenkins-hbase9:45899] regionserver.HRegionServer(951): ClusterId : 05c01ca0-07af-4e88-b391-d352bc03767d 2023-07-14 09:12:31,837 DEBUG [RS:1;jenkins-hbase9:45899] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-14 09:12:31,839 DEBUG [RS:0;jenkins-hbase9:37313] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-14 09:12:31,848 INFO [RS:2;jenkins-hbase9:41875] regionserver.HRegionServer(951): ClusterId : 05c01ca0-07af-4e88-b391-d352bc03767d 2023-07-14 09:12:31,851 DEBUG [RS:2;jenkins-hbase9:41875] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-14 09:12:31,856 DEBUG [RS:1;jenkins-hbase9:45899] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-14 09:12:31,856 DEBUG [RS:1;jenkins-hbase9:45899] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-14 09:12:31,858 DEBUG [RS:2;jenkins-hbase9:41875] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-14 09:12:31,858 DEBUG [RS:2;jenkins-hbase9:41875] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-14 09:12:31,868 DEBUG [RS:2;jenkins-hbase9:41875] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-14 09:12:31,870 DEBUG [RS:2;jenkins-hbase9:41875] zookeeper.ReadOnlyZKClient(139): Connect 0x52052cea to 127.0.0.1:59920 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:12:31,879 DEBUG [RS:1;jenkins-hbase9:45899] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-14 09:12:31,883 DEBUG [RS:0;jenkins-hbase9:37313] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-14 09:12:31,883 DEBUG [RS:0;jenkins-hbase9:37313] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-14 09:12:31,884 DEBUG [RS:1;jenkins-hbase9:45899] zookeeper.ReadOnlyZKClient(139): Connect 0x0babf758 to 127.0.0.1:59920 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:12:31,890 DEBUG [RS:0;jenkins-hbase9:37313] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-14 09:12:31,895 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-14 09:12:31,907 INFO [master/jenkins-hbase9:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 09:12:31,907 INFO [master/jenkins-hbase9:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-14 09:12:31,929 DEBUG [RS:0;jenkins-hbase9:37313] zookeeper.ReadOnlyZKClient(139): Connect 0x2c8bbae5 to 127.0.0.1:59920 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:12:31,934 DEBUG [RS:2;jenkins-hbase9:41875] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1707b8ce, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:12:31,935 DEBUG [RS:2;jenkins-hbase9:41875] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2574fc23, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-14 09:12:31,941 DEBUG [RS:1;jenkins-hbase9:45899] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6897342c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:12:31,941 DEBUG [RS:1;jenkins-hbase9:45899] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7cfa4859, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-14 09:12:31,992 DEBUG [RS:1;jenkins-hbase9:45899] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase9:45899 2023-07-14 09:12:31,996 DEBUG [RS:2;jenkins-hbase9:41875] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase9:41875 2023-07-14 09:12:31,998 DEBUG [RS:0;jenkins-hbase9:37313] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5dedd211, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:12:31,999 DEBUG [RS:0;jenkins-hbase9:37313] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4581be9f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-14 09:12:32,003 INFO [RS:1;jenkins-hbase9:45899] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-14 09:12:32,003 INFO [RS:1;jenkins-hbase9:45899] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-14 09:12:32,003 DEBUG [RS:1;jenkins-hbase9:45899] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-14 09:12:32,004 INFO [RS:2;jenkins-hbase9:41875] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-14 09:12:32,023 INFO [RS:2;jenkins-hbase9:41875] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-14 09:12:32,023 DEBUG [RS:2;jenkins-hbase9:41875] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-14 09:12:32,023 INFO [RS:2;jenkins-hbase9:41875] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 09:12:32,023 DEBUG [RS:2;jenkins-hbase9:41875] regionserver.HRegionServer(1022): About to register with Master. 2023-07-14 09:12:32,023 DEBUG [RS:0;jenkins-hbase9:37313] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase9:37313 2023-07-14 09:12:32,023 INFO [RS:0;jenkins-hbase9:37313] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-14 09:12:32,024 INFO [RS:0;jenkins-hbase9:37313] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-14 09:12:32,024 DEBUG [RS:0;jenkins-hbase9:37313] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-14 09:12:32,024 INFO [RS:0;jenkins-hbase9:37313] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 09:12:32,024 DEBUG [RS:0;jenkins-hbase9:37313] regionserver.HRegionServer(1022): About to register with Master. 2023-07-14 09:12:32,007 INFO [RS:1;jenkins-hbase9:45899] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 09:12:32,026 DEBUG [RS:1;jenkins-hbase9:45899] regionserver.HRegionServer(1022): About to register with Master. 2023-07-14 09:12:32,030 INFO [RS:1;jenkins-hbase9:45899] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,41733,1689325948012 with isa=jenkins-hbase9.apache.org/172.31.2.10:45899, startcode=1689325949913 2023-07-14 09:12:32,030 INFO [RS:0;jenkins-hbase9:37313] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,41733,1689325948012 with isa=jenkins-hbase9.apache.org/172.31.2.10:37313, startcode=1689325949765 2023-07-14 09:12:32,035 INFO [RS:2;jenkins-hbase9:41875] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,41733,1689325948012 with isa=jenkins-hbase9.apache.org/172.31.2.10:41875, startcode=1689325950034 2023-07-14 09:12:32,043 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-14 09:12:32,059 DEBUG [RS:0;jenkins-hbase9:37313] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-14 09:12:32,059 DEBUG [RS:1;jenkins-hbase9:45899] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-14 09:12:32,059 DEBUG [RS:2;jenkins-hbase9:41875] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-14 09:12:32,069 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-14 09:12:32,070 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-14 09:12:32,070 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-14 09:12:32,070 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-14 09:12:32,070 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase9:0, corePoolSize=10, maxPoolSize=10 2023-07-14 09:12:32,070 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,070 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-14 09:12:32,070 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,119 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689325982119 2023-07-14 09:12:32,122 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-14 09:12:32,159 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-14 09:12:32,169 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-14 09:12:32,170 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-14 09:12:32,172 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-14 09:12:32,172 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-14 09:12:32,173 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-14 09:12:32,173 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-14 09:12:32,182 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-14 09:12:32,186 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-14 09:12:32,190 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-14 09:12:32,195 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-14 09:12:32,196 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-14 09:12:32,207 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-14 09:12:32,208 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-14 09:12:32,212 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:50663, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-14 09:12:32,215 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1689325952210,5,FailOnTimeoutGroup] 2023-07-14 09:12:32,233 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1689325952216,5,FailOnTimeoutGroup] 2023-07-14 09:12:32,233 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-14 09:12:32,233 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-14 09:12:32,235 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-14 09:12:32,235 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-14 09:12:32,217 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:59473, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-14 09:12:32,221 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:51643, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-14 09:12:32,268 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41733] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:12:32,319 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41733] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:12:32,320 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41733] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:12:32,329 DEBUG [RS:1;jenkins-hbase9:45899] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8 2023-07-14 09:12:32,329 DEBUG [RS:1;jenkins-hbase9:45899] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:43771 2023-07-14 09:12:32,329 DEBUG [RS:1;jenkins-hbase9:45899] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-14 09:12:32,329 DEBUG [RS:2;jenkins-hbase9:41875] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8 2023-07-14 09:12:32,330 DEBUG [RS:2;jenkins-hbase9:41875] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:43771 2023-07-14 09:12:32,330 DEBUG [RS:2;jenkins-hbase9:41875] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-14 09:12:32,330 DEBUG [RS:0;jenkins-hbase9:37313] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8 2023-07-14 09:12:32,330 DEBUG [RS:0;jenkins-hbase9:37313] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:43771 2023-07-14 09:12:32,330 DEBUG [RS:0;jenkins-hbase9:37313] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-14 09:12:32,341 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 09:12:32,342 DEBUG [RS:0;jenkins-hbase9:37313] zookeeper.ZKUtil(162): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:12:32,342 DEBUG [RS:2;jenkins-hbase9:41875] zookeeper.ZKUtil(162): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:12:32,343 DEBUG [RS:1;jenkins-hbase9:45899] zookeeper.ZKUtil(162): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:12:32,343 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-14 09:12:32,344 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-14 09:12:32,342 WARN [RS:0;jenkins-hbase9:37313] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-14 09:12:32,342 WARN [RS:2;jenkins-hbase9:41875] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-14 09:12:32,347 INFO [RS:0;jenkins-hbase9:37313] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-14 09:12:32,343 WARN [RS:1;jenkins-hbase9:45899] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-14 09:12:32,347 DEBUG [RS:0;jenkins-hbase9:37313] regionserver.HRegionServer(1948): logDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/WALs/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:12:32,345 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8 2023-07-14 09:12:32,347 INFO [RS:2;jenkins-hbase9:41875] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-14 09:12:32,347 INFO [RS:1;jenkins-hbase9:45899] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-14 09:12:32,362 DEBUG [RS:2;jenkins-hbase9:41875] regionserver.HRegionServer(1948): logDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/WALs/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:12:32,363 DEBUG [RS:1;jenkins-hbase9:45899] regionserver.HRegionServer(1948): logDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/WALs/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:12:32,363 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,45899,1689325949913] 2023-07-14 09:12:32,363 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,41875,1689325950034] 2023-07-14 09:12:32,364 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,37313,1689325949765] 2023-07-14 09:12:32,388 DEBUG [RS:1;jenkins-hbase9:45899] zookeeper.ZKUtil(162): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:12:32,388 DEBUG [RS:0;jenkins-hbase9:37313] zookeeper.ZKUtil(162): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:12:32,389 DEBUG [RS:1;jenkins-hbase9:45899] zookeeper.ZKUtil(162): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:12:32,389 DEBUG [RS:0;jenkins-hbase9:37313] zookeeper.ZKUtil(162): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:12:32,395 DEBUG [RS:1;jenkins-hbase9:45899] zookeeper.ZKUtil(162): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:12:32,395 DEBUG [RS:0;jenkins-hbase9:37313] zookeeper.ZKUtil(162): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:12:32,397 DEBUG [RS:2;jenkins-hbase9:41875] zookeeper.ZKUtil(162): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:12:32,404 DEBUG [RS:2;jenkins-hbase9:41875] zookeeper.ZKUtil(162): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:12:32,414 DEBUG [RS:2;jenkins-hbase9:41875] zookeeper.ZKUtil(162): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:12:32,426 DEBUG [RS:2;jenkins-hbase9:41875] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-14 09:12:32,426 DEBUG [RS:1;jenkins-hbase9:45899] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-14 09:12:32,426 DEBUG [RS:0;jenkins-hbase9:37313] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-14 09:12:32,432 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:12:32,441 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-14 09:12:32,441 INFO [RS:2;jenkins-hbase9:41875] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-14 09:12:32,446 INFO [RS:1;jenkins-hbase9:45899] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-14 09:12:32,442 INFO [RS:0;jenkins-hbase9:37313] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-14 09:12:32,451 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/hbase/meta/1588230740/info 2023-07-14 09:12:32,452 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-14 09:12:32,453 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 09:12:32,453 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-14 09:12:32,467 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/hbase/meta/1588230740/rep_barrier 2023-07-14 09:12:32,468 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-14 09:12:32,474 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 09:12:32,474 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-14 09:12:32,477 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/hbase/meta/1588230740/table 2023-07-14 09:12:32,478 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-14 09:12:32,479 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 09:12:32,488 INFO [RS:2;jenkins-hbase9:41875] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-14 09:12:32,493 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/hbase/meta/1588230740 2023-07-14 09:12:32,494 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/hbase/meta/1588230740 2023-07-14 09:12:32,495 INFO [RS:1;jenkins-hbase9:45899] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-14 09:12:32,502 INFO [RS:0;jenkins-hbase9:37313] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-14 09:12:32,525 INFO [RS:2;jenkins-hbase9:41875] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-14 09:12:32,526 INFO [RS:2;jenkins-hbase9:41875] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 09:12:32,533 INFO [RS:1;jenkins-hbase9:45899] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-14 09:12:32,533 INFO [RS:1;jenkins-hbase9:45899] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 09:12:32,534 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-14 09:12:32,545 INFO [RS:0;jenkins-hbase9:37313] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-14 09:12:32,546 INFO [RS:2;jenkins-hbase9:41875] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-14 09:12:32,548 INFO [RS:0;jenkins-hbase9:37313] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 09:12:32,548 INFO [RS:1;jenkins-hbase9:45899] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-14 09:12:32,548 INFO [RS:0;jenkins-hbase9:37313] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-14 09:12:32,552 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-14 09:12:32,560 INFO [RS:1;jenkins-hbase9:45899] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-14 09:12:32,560 INFO [RS:0;jenkins-hbase9:37313] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-14 09:12:32,560 INFO [RS:2;jenkins-hbase9:41875] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-14 09:12:32,560 DEBUG [RS:1;jenkins-hbase9:45899] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,560 DEBUG [RS:0;jenkins-hbase9:37313] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,561 DEBUG [RS:1;jenkins-hbase9:45899] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,561 DEBUG [RS:0;jenkins-hbase9:37313] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,561 DEBUG [RS:1;jenkins-hbase9:45899] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,561 DEBUG [RS:2;jenkins-hbase9:41875] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,561 DEBUG [RS:1;jenkins-hbase9:45899] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,561 DEBUG [RS:0;jenkins-hbase9:37313] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,561 DEBUG [RS:1;jenkins-hbase9:45899] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,561 DEBUG [RS:2;jenkins-hbase9:41875] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,561 DEBUG [RS:1;jenkins-hbase9:45899] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-14 09:12:32,562 DEBUG [RS:1;jenkins-hbase9:45899] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,562 DEBUG [RS:2;jenkins-hbase9:41875] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,562 DEBUG [RS:2;jenkins-hbase9:41875] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,562 DEBUG [RS:2;jenkins-hbase9:41875] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,562 DEBUG [RS:2;jenkins-hbase9:41875] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-14 09:12:32,562 DEBUG [RS:2;jenkins-hbase9:41875] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,563 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 09:12:32,563 DEBUG [RS:2;jenkins-hbase9:41875] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,563 DEBUG [RS:2;jenkins-hbase9:41875] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,561 DEBUG [RS:0;jenkins-hbase9:37313] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,564 DEBUG [RS:0;jenkins-hbase9:37313] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,564 DEBUG [RS:0;jenkins-hbase9:37313] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-14 09:12:32,563 DEBUG [RS:2;jenkins-hbase9:41875] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,564 DEBUG [RS:0;jenkins-hbase9:37313] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,565 DEBUG [RS:0;jenkins-hbase9:37313] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,565 DEBUG [RS:0;jenkins-hbase9:37313] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,565 DEBUG [RS:0;jenkins-hbase9:37313] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,562 DEBUG [RS:1;jenkins-hbase9:45899] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,564 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60361503, jitterRate=-0.10054351389408112}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-14 09:12:32,567 DEBUG [RS:1;jenkins-hbase9:45899] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,567 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-14 09:12:32,567 DEBUG [RS:1;jenkins-hbase9:45899] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,567 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-14 09:12:32,567 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-14 09:12:32,567 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-14 09:12:32,567 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-14 09:12:32,567 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-14 09:12:32,607 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-14 09:12:32,607 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-14 09:12:32,618 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-14 09:12:32,618 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-14 09:12:32,626 INFO [RS:2;jenkins-hbase9:41875] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 09:12:32,626 INFO [RS:2;jenkins-hbase9:41875] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 09:12:32,627 INFO [RS:2;jenkins-hbase9:41875] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-14 09:12:32,644 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-14 09:12:32,657 INFO [RS:1;jenkins-hbase9:45899] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 09:12:32,658 INFO [RS:1;jenkins-hbase9:45899] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 09:12:32,658 INFO [RS:2;jenkins-hbase9:41875] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-14 09:12:32,658 INFO [RS:1;jenkins-hbase9:45899] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-14 09:12:32,680 INFO [RS:0;jenkins-hbase9:37313] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 09:12:32,680 INFO [RS:0;jenkins-hbase9:37313] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 09:12:32,681 INFO [RS:0;jenkins-hbase9:37313] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-14 09:12:32,683 INFO [RS:2;jenkins-hbase9:41875] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,41875,1689325950034-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 09:12:32,712 INFO [RS:0;jenkins-hbase9:37313] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-14 09:12:32,723 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-14 09:12:32,724 INFO [RS:0;jenkins-hbase9:37313] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,37313,1689325949765-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 09:12:32,738 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-14 09:12:32,741 INFO [RS:1;jenkins-hbase9:45899] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-14 09:12:32,741 INFO [RS:1;jenkins-hbase9:45899] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,45899,1689325949913-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 09:12:32,761 INFO [RS:2;jenkins-hbase9:41875] regionserver.Replication(203): jenkins-hbase9.apache.org,41875,1689325950034 started 2023-07-14 09:12:32,761 INFO [RS:2;jenkins-hbase9:41875] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,41875,1689325950034, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:41875, sessionid=0x101630d0c4a0003 2023-07-14 09:12:32,762 DEBUG [RS:2;jenkins-hbase9:41875] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-14 09:12:32,762 DEBUG [RS:2;jenkins-hbase9:41875] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:12:32,762 DEBUG [RS:2;jenkins-hbase9:41875] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,41875,1689325950034' 2023-07-14 09:12:32,762 DEBUG [RS:2;jenkins-hbase9:41875] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-14 09:12:32,763 DEBUG [RS:2;jenkins-hbase9:41875] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-14 09:12:32,765 INFO [RS:1;jenkins-hbase9:45899] regionserver.Replication(203): jenkins-hbase9.apache.org,45899,1689325949913 started 2023-07-14 09:12:32,765 INFO [RS:1;jenkins-hbase9:45899] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,45899,1689325949913, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:45899, sessionid=0x101630d0c4a0002 2023-07-14 09:12:32,765 DEBUG [RS:1;jenkins-hbase9:45899] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-14 09:12:32,773 DEBUG [RS:2;jenkins-hbase9:41875] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-14 09:12:32,773 DEBUG [RS:2;jenkins-hbase9:41875] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-14 09:12:32,773 DEBUG [RS:2;jenkins-hbase9:41875] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:12:32,773 DEBUG [RS:2;jenkins-hbase9:41875] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,41875,1689325950034' 2023-07-14 09:12:32,773 DEBUG [RS:2;jenkins-hbase9:41875] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:12:32,765 DEBUG [RS:1;jenkins-hbase9:45899] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:12:32,775 DEBUG [RS:1;jenkins-hbase9:45899] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,45899,1689325949913' 2023-07-14 09:12:32,776 DEBUG [RS:1;jenkins-hbase9:45899] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-14 09:12:32,776 DEBUG [RS:2;jenkins-hbase9:41875] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:12:32,777 DEBUG [RS:1;jenkins-hbase9:45899] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-14 09:12:32,778 DEBUG [RS:2;jenkins-hbase9:41875] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-14 09:12:32,778 INFO [RS:2;jenkins-hbase9:41875] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-14 09:12:32,778 INFO [RS:2;jenkins-hbase9:41875] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-14 09:12:32,781 DEBUG [RS:1;jenkins-hbase9:45899] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-14 09:12:32,781 DEBUG [RS:1;jenkins-hbase9:45899] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-14 09:12:32,781 DEBUG [RS:1;jenkins-hbase9:45899] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:12:32,782 DEBUG [RS:1;jenkins-hbase9:45899] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,45899,1689325949913' 2023-07-14 09:12:32,782 DEBUG [RS:1;jenkins-hbase9:45899] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:12:32,783 DEBUG [RS:1;jenkins-hbase9:45899] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:12:32,784 DEBUG [RS:1;jenkins-hbase9:45899] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-14 09:12:32,802 INFO [RS:0;jenkins-hbase9:37313] regionserver.Replication(203): jenkins-hbase9.apache.org,37313,1689325949765 started 2023-07-14 09:12:32,802 INFO [RS:0;jenkins-hbase9:37313] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,37313,1689325949765, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:37313, sessionid=0x101630d0c4a0001 2023-07-14 09:12:32,802 DEBUG [RS:0;jenkins-hbase9:37313] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-14 09:12:32,802 DEBUG [RS:0;jenkins-hbase9:37313] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:12:32,802 DEBUG [RS:0;jenkins-hbase9:37313] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,37313,1689325949765' 2023-07-14 09:12:32,802 DEBUG [RS:0;jenkins-hbase9:37313] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-14 09:12:32,784 INFO [RS:1;jenkins-hbase9:45899] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-14 09:12:32,803 INFO [RS:1;jenkins-hbase9:45899] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-14 09:12:32,806 DEBUG [RS:0;jenkins-hbase9:37313] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-14 09:12:32,813 DEBUG [RS:0;jenkins-hbase9:37313] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-14 09:12:32,813 DEBUG [RS:0;jenkins-hbase9:37313] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-14 09:12:32,813 DEBUG [RS:0;jenkins-hbase9:37313] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:12:32,813 DEBUG [RS:0;jenkins-hbase9:37313] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,37313,1689325949765' 2023-07-14 09:12:32,813 DEBUG [RS:0;jenkins-hbase9:37313] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:12:32,814 DEBUG [RS:0;jenkins-hbase9:37313] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:12:32,815 DEBUG [RS:0;jenkins-hbase9:37313] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-14 09:12:32,815 INFO [RS:0;jenkins-hbase9:37313] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-14 09:12:32,815 INFO [RS:0;jenkins-hbase9:37313] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-14 09:12:32,892 DEBUG [jenkins-hbase9:41733] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-14 09:12:32,895 INFO [RS:2;jenkins-hbase9:41875] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C41875%2C1689325950034, suffix=, logDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/WALs/jenkins-hbase9.apache.org,41875,1689325950034, archiveDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/oldWALs, maxLogs=32 2023-07-14 09:12:32,900 DEBUG [jenkins-hbase9:41733] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 09:12:32,906 DEBUG [jenkins-hbase9:41733] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 09:12:32,907 DEBUG [jenkins-hbase9:41733] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 09:12:32,907 DEBUG [jenkins-hbase9:41733] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 09:12:32,907 DEBUG [jenkins-hbase9:41733] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 09:12:32,912 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,45899,1689325949913, state=OPENING 2023-07-14 09:12:32,917 INFO [RS:1;jenkins-hbase9:45899] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C45899%2C1689325949913, suffix=, logDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/WALs/jenkins-hbase9.apache.org,45899,1689325949913, archiveDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/oldWALs, maxLogs=32 2023-07-14 09:12:32,921 INFO [RS:0;jenkins-hbase9:37313] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C37313%2C1689325949765, suffix=, logDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/WALs/jenkins-hbase9.apache.org,37313,1689325949765, archiveDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/oldWALs, maxLogs=32 2023-07-14 09:12:32,944 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-14 09:12:32,946 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 09:12:32,947 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-14 09:12:32,952 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,45899,1689325949913}] 2023-07-14 09:12:33,004 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46091,DS-2f016ab3-dae5-449c-b732-b039b567365c,DISK] 2023-07-14 09:12:33,004 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42081,DS-0af70be0-51b0-4d61-825b-706e3627b856,DISK] 2023-07-14 09:12:33,004 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35937,DS-80a6a851-c424-4858-adbb-de8f65a4225d,DISK] 2023-07-14 09:12:33,006 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35937,DS-80a6a851-c424-4858-adbb-de8f65a4225d,DISK] 2023-07-14 09:12:33,008 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46091,DS-2f016ab3-dae5-449c-b732-b039b567365c,DISK] 2023-07-14 09:12:33,010 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42081,DS-0af70be0-51b0-4d61-825b-706e3627b856,DISK] 2023-07-14 09:12:33,034 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42081,DS-0af70be0-51b0-4d61-825b-706e3627b856,DISK] 2023-07-14 09:12:33,035 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35937,DS-80a6a851-c424-4858-adbb-de8f65a4225d,DISK] 2023-07-14 09:12:33,036 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46091,DS-2f016ab3-dae5-449c-b732-b039b567365c,DISK] 2023-07-14 09:12:33,048 INFO [RS:2;jenkins-hbase9:41875] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/WALs/jenkins-hbase9.apache.org,41875,1689325950034/jenkins-hbase9.apache.org%2C41875%2C1689325950034.1689325952901 2023-07-14 09:12:33,054 DEBUG [RS:2;jenkins-hbase9:41875] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35937,DS-80a6a851-c424-4858-adbb-de8f65a4225d,DISK], DatanodeInfoWithStorage[127.0.0.1:46091,DS-2f016ab3-dae5-449c-b732-b039b567365c,DISK], DatanodeInfoWithStorage[127.0.0.1:42081,DS-0af70be0-51b0-4d61-825b-706e3627b856,DISK]] 2023-07-14 09:12:33,054 INFO [RS:0;jenkins-hbase9:37313] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/WALs/jenkins-hbase9.apache.org,37313,1689325949765/jenkins-hbase9.apache.org%2C37313%2C1689325949765.1689325952923 2023-07-14 09:12:33,055 INFO [RS:1;jenkins-hbase9:45899] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/WALs/jenkins-hbase9.apache.org,45899,1689325949913/jenkins-hbase9.apache.org%2C45899%2C1689325949913.1689325952920 2023-07-14 09:12:33,055 DEBUG [RS:0;jenkins-hbase9:37313] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35937,DS-80a6a851-c424-4858-adbb-de8f65a4225d,DISK], DatanodeInfoWithStorage[127.0.0.1:42081,DS-0af70be0-51b0-4d61-825b-706e3627b856,DISK], DatanodeInfoWithStorage[127.0.0.1:46091,DS-2f016ab3-dae5-449c-b732-b039b567365c,DISK]] 2023-07-14 09:12:33,057 DEBUG [RS:1;jenkins-hbase9:45899] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42081,DS-0af70be0-51b0-4d61-825b-706e3627b856,DISK], DatanodeInfoWithStorage[127.0.0.1:46091,DS-2f016ab3-dae5-449c-b732-b039b567365c,DISK], DatanodeInfoWithStorage[127.0.0.1:35937,DS-80a6a851-c424-4858-adbb-de8f65a4225d,DISK]] 2023-07-14 09:12:33,235 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:12:33,238 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-14 09:12:33,243 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:39864, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-14 09:12:33,271 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-14 09:12:33,272 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-14 09:12:33,279 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C45899%2C1689325949913.meta, suffix=.meta, logDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/WALs/jenkins-hbase9.apache.org,45899,1689325949913, archiveDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/oldWALs, maxLogs=32 2023-07-14 09:12:33,334 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35937,DS-80a6a851-c424-4858-adbb-de8f65a4225d,DISK] 2023-07-14 09:12:33,335 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46091,DS-2f016ab3-dae5-449c-b732-b039b567365c,DISK] 2023-07-14 09:12:33,344 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42081,DS-0af70be0-51b0-4d61-825b-706e3627b856,DISK] 2023-07-14 09:12:33,361 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/WALs/jenkins-hbase9.apache.org,45899,1689325949913/jenkins-hbase9.apache.org%2C45899%2C1689325949913.meta.1689325953281.meta 2023-07-14 09:12:33,364 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35937,DS-80a6a851-c424-4858-adbb-de8f65a4225d,DISK], DatanodeInfoWithStorage[127.0.0.1:46091,DS-2f016ab3-dae5-449c-b732-b039b567365c,DISK], DatanodeInfoWithStorage[127.0.0.1:42081,DS-0af70be0-51b0-4d61-825b-706e3627b856,DISK]] 2023-07-14 09:12:33,365 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-14 09:12:33,366 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-14 09:12:33,367 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 09:12:33,368 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-14 09:12:33,371 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-14 09:12:33,372 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-14 09:12:33,403 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-14 09:12:33,403 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:12:33,403 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-14 09:12:33,403 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-14 09:12:33,426 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-14 09:12:33,430 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/hbase/meta/1588230740/info 2023-07-14 09:12:33,430 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/hbase/meta/1588230740/info 2023-07-14 09:12:33,431 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-14 09:12:33,432 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 09:12:33,432 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-14 09:12:33,434 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/hbase/meta/1588230740/rep_barrier 2023-07-14 09:12:33,434 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/hbase/meta/1588230740/rep_barrier 2023-07-14 09:12:33,435 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-14 09:12:33,436 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 09:12:33,436 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-14 09:12:33,438 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/hbase/meta/1588230740/table 2023-07-14 09:12:33,438 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/hbase/meta/1588230740/table 2023-07-14 09:12:33,438 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-14 09:12:33,439 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 09:12:33,442 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/hbase/meta/1588230740 2023-07-14 09:12:33,449 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/hbase/meta/1588230740 2023-07-14 09:12:33,456 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-14 09:12:33,459 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-14 09:12:33,461 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67925121, jitterRate=0.012163177132606506}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-14 09:12:33,464 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-14 09:12:33,487 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689325953222 2023-07-14 09:12:33,514 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-14 09:12:33,515 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-14 09:12:33,517 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,45899,1689325949913, state=OPEN 2023-07-14 09:12:33,526 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-14 09:12:33,526 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-14 09:12:33,551 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-14 09:12:33,551 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,45899,1689325949913 in 574 msec 2023-07-14 09:12:33,571 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-14 09:12:33,571 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 912 msec 2023-07-14 09:12:33,586 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.6660 sec 2023-07-14 09:12:33,586 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689325953586, completionTime=-1 2023-07-14 09:12:33,587 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-14 09:12:33,587 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-14 09:12:33,681 DEBUG [hconnection-0x6b086784-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:12:33,688 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:39880, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:12:33,714 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-14 09:12:33,714 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689326013714 2023-07-14 09:12:33,714 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689326073714 2023-07-14 09:12:33,714 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 127 msec 2023-07-14 09:12:33,747 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,41733,1689325948012-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 09:12:33,748 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,41733,1689325948012-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-14 09:12:33,748 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,41733,1689325948012-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-14 09:12:33,751 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase9:41733, period=300000, unit=MILLISECONDS is enabled. 2023-07-14 09:12:33,751 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-14 09:12:33,761 DEBUG [master/jenkins-hbase9:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-14 09:12:33,784 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-14 09:12:33,785 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-14 09:12:33,799 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-14 09:12:33,805 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 09:12:33,808 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 09:12:33,838 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/hbase/namespace/a31c75d31bc38f2da6b8ff6a09c13ed8 2023-07-14 09:12:33,850 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/hbase/namespace/a31c75d31bc38f2da6b8ff6a09c13ed8 empty. 2023-07-14 09:12:33,853 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/hbase/namespace/a31c75d31bc38f2da6b8ff6a09c13ed8 2023-07-14 09:12:33,854 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-14 09:12:33,913 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-14 09:12:33,930 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => a31c75d31bc38f2da6b8ff6a09c13ed8, NAME => 'hbase:namespace,,1689325953785.a31c75d31bc38f2da6b8ff6a09c13ed8.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp 2023-07-14 09:12:33,973 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689325953785.a31c75d31bc38f2da6b8ff6a09c13ed8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:12:33,973 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing a31c75d31bc38f2da6b8ff6a09c13ed8, disabling compactions & flushes 2023-07-14 09:12:33,973 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689325953785.a31c75d31bc38f2da6b8ff6a09c13ed8. 2023-07-14 09:12:33,973 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689325953785.a31c75d31bc38f2da6b8ff6a09c13ed8. 2023-07-14 09:12:33,973 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689325953785.a31c75d31bc38f2da6b8ff6a09c13ed8. after waiting 0 ms 2023-07-14 09:12:33,973 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689325953785.a31c75d31bc38f2da6b8ff6a09c13ed8. 2023-07-14 09:12:33,973 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689325953785.a31c75d31bc38f2da6b8ff6a09c13ed8. 2023-07-14 09:12:33,973 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for a31c75d31bc38f2da6b8ff6a09c13ed8: 2023-07-14 09:12:33,979 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 09:12:34,000 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689325953785.a31c75d31bc38f2da6b8ff6a09c13ed8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689325953983"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689325953983"}]},"ts":"1689325953983"} 2023-07-14 09:12:34,034 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-14 09:12:34,036 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 09:12:34,041 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689325954036"}]},"ts":"1689325954036"} 2023-07-14 09:12:34,051 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-14 09:12:34,061 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 09:12:34,063 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 09:12:34,063 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 09:12:34,063 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 09:12:34,063 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 09:12:34,067 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=a31c75d31bc38f2da6b8ff6a09c13ed8, ASSIGN}] 2023-07-14 09:12:34,070 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=a31c75d31bc38f2da6b8ff6a09c13ed8, ASSIGN 2023-07-14 09:12:34,073 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=a31c75d31bc38f2da6b8ff6a09c13ed8, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45899,1689325949913; forceNewPlan=false, retain=false 2023-07-14 09:12:34,226 INFO [jenkins-hbase9:41733] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-14 09:12:34,227 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=a31c75d31bc38f2da6b8ff6a09c13ed8, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:12:34,227 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689325953785.a31c75d31bc38f2da6b8ff6a09c13ed8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689325954227"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689325954227"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689325954227"}]},"ts":"1689325954227"} 2023-07-14 09:12:34,231 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure a31c75d31bc38f2da6b8ff6a09c13ed8, server=jenkins-hbase9.apache.org,45899,1689325949913}] 2023-07-14 09:12:34,394 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689325953785.a31c75d31bc38f2da6b8ff6a09c13ed8. 2023-07-14 09:12:34,395 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a31c75d31bc38f2da6b8ff6a09c13ed8, NAME => 'hbase:namespace,,1689325953785.a31c75d31bc38f2da6b8ff6a09c13ed8.', STARTKEY => '', ENDKEY => ''} 2023-07-14 09:12:34,395 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689325953785.a31c75d31bc38f2da6b8ff6a09c13ed8. service=AccessControlService 2023-07-14 09:12:34,396 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 09:12:34,397 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace a31c75d31bc38f2da6b8ff6a09c13ed8 2023-07-14 09:12:34,397 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689325953785.a31c75d31bc38f2da6b8ff6a09c13ed8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:12:34,397 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for a31c75d31bc38f2da6b8ff6a09c13ed8 2023-07-14 09:12:34,397 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for a31c75d31bc38f2da6b8ff6a09c13ed8 2023-07-14 09:12:34,400 INFO [StoreOpener-a31c75d31bc38f2da6b8ff6a09c13ed8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region a31c75d31bc38f2da6b8ff6a09c13ed8 2023-07-14 09:12:34,403 DEBUG [StoreOpener-a31c75d31bc38f2da6b8ff6a09c13ed8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/hbase/namespace/a31c75d31bc38f2da6b8ff6a09c13ed8/info 2023-07-14 09:12:34,403 DEBUG [StoreOpener-a31c75d31bc38f2da6b8ff6a09c13ed8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/hbase/namespace/a31c75d31bc38f2da6b8ff6a09c13ed8/info 2023-07-14 09:12:34,404 INFO [StoreOpener-a31c75d31bc38f2da6b8ff6a09c13ed8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a31c75d31bc38f2da6b8ff6a09c13ed8 columnFamilyName info 2023-07-14 09:12:34,404 INFO [StoreOpener-a31c75d31bc38f2da6b8ff6a09c13ed8-1] regionserver.HStore(310): Store=a31c75d31bc38f2da6b8ff6a09c13ed8/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 09:12:34,407 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/hbase/namespace/a31c75d31bc38f2da6b8ff6a09c13ed8 2023-07-14 09:12:34,408 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/hbase/namespace/a31c75d31bc38f2da6b8ff6a09c13ed8 2023-07-14 09:12:34,412 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for a31c75d31bc38f2da6b8ff6a09c13ed8 2023-07-14 09:12:34,419 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/hbase/namespace/a31c75d31bc38f2da6b8ff6a09c13ed8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 09:12:34,420 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened a31c75d31bc38f2da6b8ff6a09c13ed8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62127771, jitterRate=-0.0742240697145462}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 09:12:34,420 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for a31c75d31bc38f2da6b8ff6a09c13ed8: 2023-07-14 09:12:34,422 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689325953785.a31c75d31bc38f2da6b8ff6a09c13ed8., pid=6, masterSystemTime=1689325954385 2023-07-14 09:12:34,427 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689325953785.a31c75d31bc38f2da6b8ff6a09c13ed8. 2023-07-14 09:12:34,427 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689325953785.a31c75d31bc38f2da6b8ff6a09c13ed8. 2023-07-14 09:12:34,429 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=a31c75d31bc38f2da6b8ff6a09c13ed8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:12:34,429 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689325953785.a31c75d31bc38f2da6b8ff6a09c13ed8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689325954428"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689325954428"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689325954428"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689325954428"}]},"ts":"1689325954428"} 2023-07-14 09:12:34,441 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-14 09:12:34,441 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure a31c75d31bc38f2da6b8ff6a09c13ed8, server=jenkins-hbase9.apache.org,45899,1689325949913 in 204 msec 2023-07-14 09:12:34,446 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-14 09:12:34,447 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=a31c75d31bc38f2da6b8ff6a09c13ed8, ASSIGN in 375 msec 2023-07-14 09:12:34,448 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 09:12:34,449 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689325954449"}]},"ts":"1689325954449"} 2023-07-14 09:12:34,452 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-14 09:12:34,456 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 09:12:34,459 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 669 msec 2023-07-14 09:12:34,502 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-14 09:12:34,504 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-14 09:12:34,504 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 09:12:34,539 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-14 09:12:34,570 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-14 09:12:34,588 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 48 msec 2023-07-14 09:12:34,594 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-14 09:12:34,613 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-14 09:12:34,619 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 24 msec 2023-07-14 09:12:34,643 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-14 09:12:34,649 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-14 09:12:34,649 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 4.486sec 2023-07-14 09:12:34,659 DEBUG [Listener at localhost/40607] zookeeper.ReadOnlyZKClient(139): Connect 0x32306b66 to 127.0.0.1:59920 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:12:34,659 INFO [master/jenkins-hbase9:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-14 09:12:34,671 INFO [master/jenkins-hbase9:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-14 09:12:34,671 INFO [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-14 09:12:34,673 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,41733,1689325948012-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-14 09:12:34,674 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,41733,1689325948012-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-14 09:12:34,690 DEBUG [Listener at localhost/40607] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@70ecbb81, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:12:34,713 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-14 09:12:34,717 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-14 09:12:34,722 DEBUG [hconnection-0x570f5d1d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:12:34,725 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 09:12:34,728 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 09:12:34,730 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-14 09:12:34,743 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/hbase/acl/2f3365ac32cf3617812342edf7d92305 2023-07-14 09:12:34,743 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:39892, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:12:34,744 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-14 09:12:34,745 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/hbase/acl/2f3365ac32cf3617812342edf7d92305 empty. 2023-07-14 09:12:34,747 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/hbase/acl/2f3365ac32cf3617812342edf7d92305 2023-07-14 09:12:34,747 INFO [Listener at localhost/40607] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase9.apache.org,41733,1689325948012 2023-07-14 09:12:34,747 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-14 09:12:34,748 INFO [Listener at localhost/40607] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-14 09:12:34,748 INFO [Listener at localhost/40607] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/test.cache.data in system properties and HBase conf 2023-07-14 09:12:34,748 INFO [Listener at localhost/40607] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/hadoop.tmp.dir in system properties and HBase conf 2023-07-14 09:12:34,748 INFO [Listener at localhost/40607] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/hadoop.log.dir in system properties and HBase conf 2023-07-14 09:12:34,748 INFO [Listener at localhost/40607] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-14 09:12:34,748 INFO [Listener at localhost/40607] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-14 09:12:34,748 INFO [Listener at localhost/40607] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-14 09:12:34,748 INFO [Listener at localhost/40607] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-14 09:12:34,749 INFO [Listener at localhost/40607] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-14 09:12:34,749 INFO [Listener at localhost/40607] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-14 09:12:34,749 INFO [Listener at localhost/40607] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-14 09:12:34,749 INFO [Listener at localhost/40607] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-14 09:12:34,749 INFO [Listener at localhost/40607] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-14 09:12:34,749 INFO [Listener at localhost/40607] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-14 09:12:34,749 INFO [Listener at localhost/40607] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-14 09:12:34,749 INFO [Listener at localhost/40607] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-14 09:12:34,750 INFO [Listener at localhost/40607] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/nfs.dump.dir in system properties and HBase conf 2023-07-14 09:12:34,750 INFO [Listener at localhost/40607] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/java.io.tmpdir in system properties and HBase conf 2023-07-14 09:12:34,750 INFO [Listener at localhost/40607] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-14 09:12:34,750 INFO [Listener at localhost/40607] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-14 09:12:34,750 INFO [Listener at localhost/40607] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-14 09:12:34,855 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-14 09:12:34,859 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-14 09:12:34,881 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2f3365ac32cf3617812342edf7d92305, NAME => 'hbase:acl,,1689325954708.2f3365ac32cf3617812342edf7d92305.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp 2023-07-14 09:12:34,986 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689325954708.2f3365ac32cf3617812342edf7d92305.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:12:34,986 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 2f3365ac32cf3617812342edf7d92305, disabling compactions & flushes 2023-07-14 09:12:34,986 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689325954708.2f3365ac32cf3617812342edf7d92305. 2023-07-14 09:12:34,986 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689325954708.2f3365ac32cf3617812342edf7d92305. 2023-07-14 09:12:34,986 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689325954708.2f3365ac32cf3617812342edf7d92305. after waiting 0 ms 2023-07-14 09:12:34,986 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689325954708.2f3365ac32cf3617812342edf7d92305. 2023-07-14 09:12:34,987 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689325954708.2f3365ac32cf3617812342edf7d92305. 2023-07-14 09:12:34,987 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 2f3365ac32cf3617812342edf7d92305: 2023-07-14 09:12:34,992 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 09:12:34,999 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689325954708.2f3365ac32cf3617812342edf7d92305.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689325954998"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689325954998"}]},"ts":"1689325954998"} 2023-07-14 09:12:35,007 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-14 09:12:35,012 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 09:12:35,013 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689325955012"}]},"ts":"1689325955012"} 2023-07-14 09:12:35,016 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-14 09:12:35,023 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 09:12:35,030 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 09:12:35,030 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 09:12:35,030 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 09:12:35,030 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 09:12:35,031 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=2f3365ac32cf3617812342edf7d92305, ASSIGN}] 2023-07-14 09:12:35,034 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=2f3365ac32cf3617812342edf7d92305, ASSIGN 2023-07-14 09:12:35,036 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=2f3365ac32cf3617812342edf7d92305, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,41875,1689325950034; forceNewPlan=false, retain=false 2023-07-14 09:12:35,059 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-14 09:12:35,186 INFO [jenkins-hbase9:41733] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-14 09:12:35,187 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=2f3365ac32cf3617812342edf7d92305, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:12:35,188 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689325954708.2f3365ac32cf3617812342edf7d92305.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689325955187"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689325955187"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689325955187"}]},"ts":"1689325955187"} 2023-07-14 09:12:35,192 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 2f3365ac32cf3617812342edf7d92305, server=jenkins-hbase9.apache.org,41875,1689325950034}] 2023-07-14 09:12:35,403 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-14 09:12:35,403 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:12:35,404 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-14 09:12:35,413 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:33038, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-14 09:12:35,434 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689325954708.2f3365ac32cf3617812342edf7d92305. 2023-07-14 09:12:35,435 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2f3365ac32cf3617812342edf7d92305, NAME => 'hbase:acl,,1689325954708.2f3365ac32cf3617812342edf7d92305.', STARTKEY => '', ENDKEY => ''} 2023-07-14 09:12:35,435 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689325954708.2f3365ac32cf3617812342edf7d92305. service=AccessControlService 2023-07-14 09:12:35,436 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 09:12:35,436 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 2f3365ac32cf3617812342edf7d92305 2023-07-14 09:12:35,436 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689325954708.2f3365ac32cf3617812342edf7d92305.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:12:35,436 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 2f3365ac32cf3617812342edf7d92305 2023-07-14 09:12:35,436 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 2f3365ac32cf3617812342edf7d92305 2023-07-14 09:12:35,440 INFO [StoreOpener-2f3365ac32cf3617812342edf7d92305-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 2f3365ac32cf3617812342edf7d92305 2023-07-14 09:12:35,446 DEBUG [StoreOpener-2f3365ac32cf3617812342edf7d92305-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/hbase/acl/2f3365ac32cf3617812342edf7d92305/l 2023-07-14 09:12:35,446 DEBUG [StoreOpener-2f3365ac32cf3617812342edf7d92305-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/hbase/acl/2f3365ac32cf3617812342edf7d92305/l 2023-07-14 09:12:35,446 INFO [StoreOpener-2f3365ac32cf3617812342edf7d92305-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2f3365ac32cf3617812342edf7d92305 columnFamilyName l 2023-07-14 09:12:35,458 INFO [StoreOpener-2f3365ac32cf3617812342edf7d92305-1] regionserver.HStore(310): Store=2f3365ac32cf3617812342edf7d92305/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 09:12:35,464 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/hbase/acl/2f3365ac32cf3617812342edf7d92305 2023-07-14 09:12:35,468 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/hbase/acl/2f3365ac32cf3617812342edf7d92305 2023-07-14 09:12:35,478 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 2f3365ac32cf3617812342edf7d92305 2023-07-14 09:12:35,488 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/hbase/acl/2f3365ac32cf3617812342edf7d92305/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 09:12:35,489 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 2f3365ac32cf3617812342edf7d92305; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75234093, jitterRate=0.1210753470659256}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 09:12:35,490 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 2f3365ac32cf3617812342edf7d92305: 2023-07-14 09:12:35,492 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689325954708.2f3365ac32cf3617812342edf7d92305., pid=11, masterSystemTime=1689325955403 2023-07-14 09:12:35,497 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689325954708.2f3365ac32cf3617812342edf7d92305. 2023-07-14 09:12:35,499 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689325954708.2f3365ac32cf3617812342edf7d92305. 2023-07-14 09:12:35,503 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=2f3365ac32cf3617812342edf7d92305, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:12:35,503 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689325954708.2f3365ac32cf3617812342edf7d92305.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689325955503"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689325955503"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689325955503"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689325955503"}]},"ts":"1689325955503"} 2023-07-14 09:12:35,515 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-14 09:12:35,515 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 2f3365ac32cf3617812342edf7d92305, server=jenkins-hbase9.apache.org,41875,1689325950034 in 319 msec 2023-07-14 09:12:35,521 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-14 09:12:35,521 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=2f3365ac32cf3617812342edf7d92305, ASSIGN in 484 msec 2023-07-14 09:12:35,524 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 09:12:35,525 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689325955525"}]},"ts":"1689325955525"} 2023-07-14 09:12:35,528 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-14 09:12:35,532 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 09:12:35,538 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 817 msec 2023-07-14 09:12:35,903 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-14 09:12:35,904 INFO [master/jenkins-hbase9:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-14 09:12:35,928 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-14 09:12:36,733 WARN [Thread-384] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 09:12:37,073 INFO [Thread-384] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 09:12:37,086 INFO [Thread-384] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_41243_jobhistory____rip6hk/webapp 2023-07-14 09:12:37,266 INFO [Thread-384] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-14 09:12:37,266 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-14 09:12:37,266 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-14 09:12:37,271 INFO [Thread-384] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-14 09:12:37,360 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 09:12:37,702 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 09:12:38,188 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-14 09:12:38,230 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 09:12:38,231 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-14 09:12:38,231 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 09:12:38,231 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-14 09:12:38,232 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-14 09:12:38,232 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-14 09:12:38,232 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 09:12:38,232 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-14 09:12:38,232 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-14 09:12:38,232 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-14 09:12:38,250 INFO [Thread-384] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:41243 2023-07-14 09:12:39,158 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 09:12:39,278 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-14 09:12:39,282 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-14 09:12:39,283 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-14 09:12:39,942 WARN [Listener at jenkins-hbase9.apache.org/36609] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 09:12:40,042 WARN [Listener at jenkins-hbase9.apache.org/36609] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-14 09:12:40,043 INFO [Listener at jenkins-hbase9.apache.org/36609] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 09:12:40,066 INFO [Listener at jenkins-hbase9.apache.org/36609] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_37761_cluster____.kfyf39/webapp 2023-07-14 09:12:40,184 INFO [Listener at jenkins-hbase9.apache.org/36609] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-14 09:12:40,184 INFO [Listener at jenkins-hbase9.apache.org/36609] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-14 09:12:40,184 INFO [Listener at jenkins-hbase9.apache.org/36609] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-14 09:12:40,185 INFO [Listener at jenkins-hbase9.apache.org/36609] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-14 09:12:40,201 INFO [Listener at jenkins-hbase9.apache.org/36609] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 09:12:40,491 INFO [Listener at jenkins-hbase9.apache.org/36609] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 09:12:40,615 INFO [Listener at jenkins-hbase9.apache.org/36609] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 09:12:40,627 INFO [Listener at jenkins-hbase9.apache.org/36609] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:37761 2023-07-14 09:12:41,186 WARN [Listener at jenkins-hbase9.apache.org/44391] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 09:12:41,212 WARN [Listener at jenkins-hbase9.apache.org/44391] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-14 09:12:41,213 INFO [Listener at jenkins-hbase9.apache.org/44391] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 09:12:41,225 INFO [Listener at jenkins-hbase9.apache.org/44391] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_45843_node____3sbuy7/webapp 2023-07-14 09:12:41,320 INFO [Listener at jenkins-hbase9.apache.org/44391] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-14 09:12:41,320 INFO [Listener at jenkins-hbase9.apache.org/44391] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-14 09:12:41,320 INFO [Listener at jenkins-hbase9.apache.org/44391] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-14 09:12:41,320 INFO [Listener at jenkins-hbase9.apache.org/44391] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-14 09:12:41,328 INFO [Listener at jenkins-hbase9.apache.org/44391] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 09:12:41,353 INFO [Listener at jenkins-hbase9.apache.org/44391] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 09:12:41,456 INFO [Listener at jenkins-hbase9.apache.org/44391] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 09:12:41,496 INFO [Listener at jenkins-hbase9.apache.org/44391] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:45843 2023-07-14 09:12:41,875 WARN [Listener at jenkins-hbase9.apache.org/45395] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 09:12:41,885 WARN [Listener at jenkins-hbase9.apache.org/45395] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-14 09:12:41,885 INFO [Listener at jenkins-hbase9.apache.org/45395] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 09:12:41,903 INFO [Listener at jenkins-hbase9.apache.org/45395] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_37691_node____.q6k7ct/webapp 2023-07-14 09:12:41,976 INFO [Listener at jenkins-hbase9.apache.org/45395] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-14 09:12:41,976 INFO [Listener at jenkins-hbase9.apache.org/45395] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-14 09:12:41,977 INFO [Listener at jenkins-hbase9.apache.org/45395] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-14 09:12:41,977 INFO [Listener at jenkins-hbase9.apache.org/45395] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-14 09:12:41,988 INFO [Listener at jenkins-hbase9.apache.org/45395] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 09:12:42,007 INFO [Listener at jenkins-hbase9.apache.org/45395] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 09:12:42,120 INFO [Listener at jenkins-hbase9.apache.org/45395] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 09:12:42,142 INFO [Listener at jenkins-hbase9.apache.org/45395] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:37691 2023-07-14 09:12:42,176 INFO [Listener at jenkins-hbase9.apache.org/45395] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-14 09:12:42,178 INFO [Listener at jenkins-hbase9.apache.org/45395] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 09:12:42,245 INFO [Listener at jenkins-hbase9.apache.org/45395] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=703, OpenFileDescriptor=899, MaxFileDescriptor=60000, SystemLoadAverage=672, ProcessCount=184, AvailableMemoryMB=3521 2023-07-14 09:12:42,245 WARN [Listener at jenkins-hbase9.apache.org/45395] hbase.ResourceChecker(130): Thread=703 is superior to 500 2023-07-14 09:12:42,262 DEBUG [Listener at jenkins-hbase9.apache.org/45395] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-14 09:12:42,270 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40872, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-14 09:12:42,278 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-14 09:12:42,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-14 09:12:42,288 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 09:12:42,293 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-14 09:12:42,298 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 09:12:42,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-14 09:12:42,304 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportWithTargetName/e09c68ec302b1f6c394a5916c202763d 2023-07-14 09:12:42,304 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportWithTargetName/2f3f8339e05d5c6e05e790598e309e26 2023-07-14 09:12:42,307 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportWithTargetName/e09c68ec302b1f6c394a5916c202763d empty. 2023-07-14 09:12:42,312 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportWithTargetName/e09c68ec302b1f6c394a5916c202763d 2023-07-14 09:12:42,312 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportWithTargetName/2f3f8339e05d5c6e05e790598e309e26 empty. 2023-07-14 09:12:42,313 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportWithTargetName/2f3f8339e05d5c6e05e790598e309e26 2023-07-14 09:12:42,313 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-14 09:12:42,361 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-14 09:12:42,363 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => e09c68ec302b1f6c394a5916c202763d, NAME => 'testtb-testExportWithTargetName,,1689325962278.e09c68ec302b1f6c394a5916c202763d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp 2023-07-14 09:12:42,366 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 2f3f8339e05d5c6e05e790598e309e26, NAME => 'testtb-testExportWithTargetName,1,1689325962278.2f3f8339e05d5c6e05e790598e309e26.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp 2023-07-14 09:12:42,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-14 09:12:42,502 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689325962278.2f3f8339e05d5c6e05e790598e309e26.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:12:42,503 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 2f3f8339e05d5c6e05e790598e309e26, disabling compactions & flushes 2023-07-14 09:12:42,503 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689325962278.2f3f8339e05d5c6e05e790598e309e26. 2023-07-14 09:12:42,503 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689325962278.2f3f8339e05d5c6e05e790598e309e26. 2023-07-14 09:12:42,503 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689325962278.2f3f8339e05d5c6e05e790598e309e26. after waiting 0 ms 2023-07-14 09:12:42,503 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689325962278.2f3f8339e05d5c6e05e790598e309e26. 2023-07-14 09:12:42,503 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689325962278.2f3f8339e05d5c6e05e790598e309e26. 2023-07-14 09:12:42,503 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 2f3f8339e05d5c6e05e790598e309e26: 2023-07-14 09:12:42,507 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689325962278.e09c68ec302b1f6c394a5916c202763d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:12:42,507 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing e09c68ec302b1f6c394a5916c202763d, disabling compactions & flushes 2023-07-14 09:12:42,507 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689325962278.e09c68ec302b1f6c394a5916c202763d. 2023-07-14 09:12:42,507 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689325962278.e09c68ec302b1f6c394a5916c202763d. 2023-07-14 09:12:42,508 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689325962278.e09c68ec302b1f6c394a5916c202763d. after waiting 0 ms 2023-07-14 09:12:42,508 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689325962278.e09c68ec302b1f6c394a5916c202763d. 2023-07-14 09:12:42,508 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689325962278.e09c68ec302b1f6c394a5916c202763d. 2023-07-14 09:12:42,508 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for e09c68ec302b1f6c394a5916c202763d: 2023-07-14 09:12:42,515 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 09:12:42,517 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689325962278.2f3f8339e05d5c6e05e790598e309e26.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689325962516"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689325962516"}]},"ts":"1689325962516"} 2023-07-14 09:12:42,517 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689325962278.e09c68ec302b1f6c394a5916c202763d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689325962516"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689325962516"}]},"ts":"1689325962516"} 2023-07-14 09:12:42,580 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 09:12:42,585 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 09:12:42,585 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689325962585"}]},"ts":"1689325962585"} 2023-07-14 09:12:42,587 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-14 09:12:42,593 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 09:12:42,595 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 09:12:42,595 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 09:12:42,595 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 09:12:42,595 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 09:12:42,596 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e09c68ec302b1f6c394a5916c202763d, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2f3f8339e05d5c6e05e790598e309e26, ASSIGN}] 2023-07-14 09:12:42,599 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2f3f8339e05d5c6e05e790598e309e26, ASSIGN 2023-07-14 09:12:42,599 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e09c68ec302b1f6c394a5916c202763d, ASSIGN 2023-07-14 09:12:42,601 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2f3f8339e05d5c6e05e790598e309e26, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,41875,1689325950034; forceNewPlan=false, retain=false 2023-07-14 09:12:42,601 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e09c68ec302b1f6c394a5916c202763d, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45899,1689325949913; forceNewPlan=false, retain=false 2023-07-14 09:12:42,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-14 09:12:42,751 INFO [jenkins-hbase9:41733] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 09:12:42,754 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=2f3f8339e05d5c6e05e790598e309e26, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:12:42,754 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=e09c68ec302b1f6c394a5916c202763d, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:12:42,754 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689325962278.2f3f8339e05d5c6e05e790598e309e26.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689325962754"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689325962754"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689325962754"}]},"ts":"1689325962754"} 2023-07-14 09:12:42,755 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689325962278.e09c68ec302b1f6c394a5916c202763d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689325962754"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689325962754"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689325962754"}]},"ts":"1689325962754"} 2023-07-14 09:12:42,758 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 2f3f8339e05d5c6e05e790598e309e26, server=jenkins-hbase9.apache.org,41875,1689325950034}] 2023-07-14 09:12:42,761 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure e09c68ec302b1f6c394a5916c202763d, server=jenkins-hbase9.apache.org,45899,1689325949913}] 2023-07-14 09:12:42,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-14 09:12:42,924 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689325962278.2f3f8339e05d5c6e05e790598e309e26. 2023-07-14 09:12:42,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2f3f8339e05d5c6e05e790598e309e26, NAME => 'testtb-testExportWithTargetName,1,1689325962278.2f3f8339e05d5c6e05e790598e309e26.', STARTKEY => '1', ENDKEY => ''} 2023-07-14 09:12:42,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689325962278.2f3f8339e05d5c6e05e790598e309e26. service=AccessControlService 2023-07-14 09:12:42,925 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 09:12:42,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 2f3f8339e05d5c6e05e790598e309e26 2023-07-14 09:12:42,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689325962278.2f3f8339e05d5c6e05e790598e309e26.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:12:42,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 2f3f8339e05d5c6e05e790598e309e26 2023-07-14 09:12:42,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 2f3f8339e05d5c6e05e790598e309e26 2023-07-14 09:12:42,935 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689325962278.e09c68ec302b1f6c394a5916c202763d. 2023-07-14 09:12:42,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e09c68ec302b1f6c394a5916c202763d, NAME => 'testtb-testExportWithTargetName,,1689325962278.e09c68ec302b1f6c394a5916c202763d.', STARTKEY => '', ENDKEY => '1'} 2023-07-14 09:12:42,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689325962278.e09c68ec302b1f6c394a5916c202763d. service=AccessControlService 2023-07-14 09:12:42,936 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 09:12:42,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName e09c68ec302b1f6c394a5916c202763d 2023-07-14 09:12:42,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689325962278.e09c68ec302b1f6c394a5916c202763d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:12:42,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for e09c68ec302b1f6c394a5916c202763d 2023-07-14 09:12:42,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for e09c68ec302b1f6c394a5916c202763d 2023-07-14 09:12:42,939 INFO [StoreOpener-2f3f8339e05d5c6e05e790598e309e26-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2f3f8339e05d5c6e05e790598e309e26 2023-07-14 09:12:42,942 DEBUG [StoreOpener-2f3f8339e05d5c6e05e790598e309e26-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportWithTargetName/2f3f8339e05d5c6e05e790598e309e26/cf 2023-07-14 09:12:42,942 DEBUG [StoreOpener-2f3f8339e05d5c6e05e790598e309e26-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportWithTargetName/2f3f8339e05d5c6e05e790598e309e26/cf 2023-07-14 09:12:42,944 INFO [StoreOpener-e09c68ec302b1f6c394a5916c202763d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e09c68ec302b1f6c394a5916c202763d 2023-07-14 09:12:42,947 INFO [StoreOpener-2f3f8339e05d5c6e05e790598e309e26-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2f3f8339e05d5c6e05e790598e309e26 columnFamilyName cf 2023-07-14 09:12:42,955 INFO [StoreOpener-2f3f8339e05d5c6e05e790598e309e26-1] regionserver.HStore(310): Store=2f3f8339e05d5c6e05e790598e309e26/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 09:12:42,957 DEBUG [StoreOpener-e09c68ec302b1f6c394a5916c202763d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportWithTargetName/e09c68ec302b1f6c394a5916c202763d/cf 2023-07-14 09:12:42,958 DEBUG [StoreOpener-e09c68ec302b1f6c394a5916c202763d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportWithTargetName/e09c68ec302b1f6c394a5916c202763d/cf 2023-07-14 09:12:42,959 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportWithTargetName/2f3f8339e05d5c6e05e790598e309e26 2023-07-14 09:12:42,959 INFO [StoreOpener-e09c68ec302b1f6c394a5916c202763d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e09c68ec302b1f6c394a5916c202763d columnFamilyName cf 2023-07-14 09:12:42,960 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportWithTargetName/2f3f8339e05d5c6e05e790598e309e26 2023-07-14 09:12:42,961 INFO [StoreOpener-e09c68ec302b1f6c394a5916c202763d-1] regionserver.HStore(310): Store=e09c68ec302b1f6c394a5916c202763d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 09:12:42,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportWithTargetName/e09c68ec302b1f6c394a5916c202763d 2023-07-14 09:12:42,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportWithTargetName/e09c68ec302b1f6c394a5916c202763d 2023-07-14 09:12:42,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 2f3f8339e05d5c6e05e790598e309e26 2023-07-14 09:12:42,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for e09c68ec302b1f6c394a5916c202763d 2023-07-14 09:12:42,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportWithTargetName/2f3f8339e05d5c6e05e790598e309e26/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 09:12:42,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportWithTargetName/e09c68ec302b1f6c394a5916c202763d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 09:12:42,977 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 2f3f8339e05d5c6e05e790598e309e26; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66289577, jitterRate=-0.012208327651023865}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 09:12:42,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 2f3f8339e05d5c6e05e790598e309e26: 2023-07-14 09:12:42,978 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened e09c68ec302b1f6c394a5916c202763d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71150622, jitterRate=0.060226887464523315}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 09:12:42,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for e09c68ec302b1f6c394a5916c202763d: 2023-07-14 09:12:42,986 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689325962278.2f3f8339e05d5c6e05e790598e309e26., pid=15, masterSystemTime=1689325962912 2023-07-14 09:12:42,988 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689325962278.e09c68ec302b1f6c394a5916c202763d., pid=16, masterSystemTime=1689325962914 2023-07-14 09:12:42,990 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=2f3f8339e05d5c6e05e790598e309e26, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:12:42,991 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689325962278.2f3f8339e05d5c6e05e790598e309e26.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689325962990"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689325962990"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689325962990"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689325962990"}]},"ts":"1689325962990"} 2023-07-14 09:12:42,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689325962278.e09c68ec302b1f6c394a5916c202763d. 2023-07-14 09:12:42,991 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689325962278.e09c68ec302b1f6c394a5916c202763d. 2023-07-14 09:12:42,992 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=e09c68ec302b1f6c394a5916c202763d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:12:42,993 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689325962278.e09c68ec302b1f6c394a5916c202763d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689325962992"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689325962992"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689325962992"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689325962992"}]},"ts":"1689325962992"} 2023-07-14 09:12:42,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689325962278.2f3f8339e05d5c6e05e790598e309e26. 2023-07-14 09:12:42,993 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689325962278.2f3f8339e05d5c6e05e790598e309e26. 2023-07-14 09:12:42,998 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-14 09:12:43,002 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 2f3f8339e05d5c6e05e790598e309e26, server=jenkins-hbase9.apache.org,41875,1689325950034 in 236 msec 2023-07-14 09:12:43,003 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-14 09:12:43,004 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure e09c68ec302b1f6c394a5916c202763d, server=jenkins-hbase9.apache.org,45899,1689325949913 in 235 msec 2023-07-14 09:12:43,005 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2f3f8339e05d5c6e05e790598e309e26, ASSIGN in 406 msec 2023-07-14 09:12:43,007 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-14 09:12:43,007 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e09c68ec302b1f6c394a5916c202763d, ASSIGN in 408 msec 2023-07-14 09:12:43,008 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 09:12:43,008 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689325963008"}]},"ts":"1689325963008"} 2023-07-14 09:12:43,010 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-14 09:12:43,018 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 09:12:43,023 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-14 09:12:43,030 DEBUG [PEWorker-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:12:43,032 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:35780, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:12:43,040 DEBUG [hconnection-0x75d2cac9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:12:43,045 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:36026, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=ClientService 2023-07-14 09:12:43,055 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41875] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-14 09:12:43,090 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-14 09:12:43,090 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-14 09:12:43,090 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-14 09:12:43,090 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-14 09:12:43,090 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 09:12:43,099 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-14 09:12:43,099 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-14 09:12:43,099 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-14 09:12:43,099 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-14 09:12:43,103 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 821 msec 2023-07-14 09:12:43,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-14 09:12:43,421 INFO [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-14 09:12:43,425 DEBUG [Listener at jenkins-hbase9.apache.org/45395] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-14 09:12:43,426 DEBUG [Listener at jenkins-hbase9.apache.org/45395] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689325962278.e09c68ec302b1f6c394a5916c202763d. 2023-07-14 09:12:43,429 INFO [Listener at jenkins-hbase9.apache.org/45395] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 09:12:43,458 DEBUG [hconnection-0x570f5d1d-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:12:43,466 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:35790, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:12:43,483 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-14 09:12:43,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689325963483 (current time:1689325963483). 2023-07-14 09:12:43,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 09:12:43,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] zookeeper.ReadOnlyZKClient(139): Connect 0x1ac2ac38 to 127.0.0.1:59920 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:12:43,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6475dc3e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:12:43,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:12:43,497 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:36040, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:12:43,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1ac2ac38 to 127.0.0.1:59920 2023-07-14 09:12:43,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:12:43,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] zookeeper.ReadOnlyZKClient(139): Connect 0x0910116d to 127.0.0.1:59920 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:12:43,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e05a8b0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:12:43,607 DEBUG [hconnection-0x36d40443-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:12:43,609 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:36054, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:12:43,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:12:43,618 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:35796, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:12:43,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0910116d to 127.0.0.1:59920 2023-07-14 09:12:43,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:12:43,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-14 09:12:43,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 09:12:43,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-14 09:12:43,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-14 09:12:43,674 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-14 09:12:43,676 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689326563676 2023-07-14 09:12:43,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-14 09:12:43,676 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-14 09:12:43,680 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-14 09:12:43,681 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-14 09:12:43,684 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 09:12:43,684 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 09:12:43,692 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 16 msec 2023-07-14 09:12:43,693 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-14 09:12:43,695 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689326563695 2023-07-14 09:12:43,727 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,727 INFO [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-14 09:12:43,728 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:12:43,732 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-14 09:12:43,732 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-14 09:12:43,733 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,733 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,741 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:12:43,741 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:12:43,741 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:12:43,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:12:43,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:12:43,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:12:43,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:12:43,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:12:43,741 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:12:43,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:12:43,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,742 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:12:43,742 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:12:43,743 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,743 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,743 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,743 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:12:43,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-14 09:12:43,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-14 09:12:43,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,744 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 09:12:43,744 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-14 09:12:43,744 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-14 09:12:43,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-14 09:12:43,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,746 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-14 09:12:43,748 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,748 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,748 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,749 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-14 09:12:43,749 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-14 09:12:43,749 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-14 09:12:43,749 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:12:43,749 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:12:43,749 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:12:43,751 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-14 09:12:43,750 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-14 09:12:43,751 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-14 09:12:43,752 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-14 09:12:43,751 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-14 09:12:43,752 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41875,1689325950034' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-14 09:12:43,751 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-14 09:12:43,752 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,37313,1689325949765' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-14 09:12:43,752 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45899,1689325949913' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-14 09:12:43,755 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:12:43,755 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:12:43,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:12:43,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:12:43,756 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:12:43,756 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,756 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:12:43,756 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:12:43,756 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,756 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,756 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:12:43,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:12:43,757 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,757 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:12:43,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:12:43,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:12:43,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:12:43,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:12:43,759 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45899,1689325949913' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-14 09:12:43,759 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7dbb4bf8[Count = 1] remaining members to acquire global barrier 2023-07-14 09:12:43,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:12:43,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:12:43,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:12:43,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:12:43,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:12:43,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:12:43,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:12:43,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:12:43,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:12:43,762 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,41875,1689325950034' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-14 09:12:43,762 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7dbb4bf8[Count = 0] remaining members to acquire global barrier 2023-07-14 09:12:43,762 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-14 09:12:43,762 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,764 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,764 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,764 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,765 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:12:43,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,765 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-14 09:12:43,765 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-14 09:12:43,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,765 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-14 09:12:43,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,765 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:12:43,765 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-14 09:12:43,765 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,37313,1689325949765' in zk 2023-07-14 09:12:43,765 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 09:12:43,766 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 09:12:43,766 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 09:12:43,766 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689325962278.e09c68ec302b1f6c394a5916c202763d. 2023-07-14 09:12:43,766 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 09:12:43,766 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 09:12:43,767 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689325962278.e09c68ec302b1f6c394a5916c202763d. started... 2023-07-14 09:12:43,770 DEBUG [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689325962278.2f3f8339e05d5c6e05e790598e309e26. 2023-07-14 09:12:43,770 DEBUG [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689325962278.2f3f8339e05d5c6e05e790598e309e26. started... 2023-07-14 09:12:43,770 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-14 09:12:43,771 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:12:43,771 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-14 09:12:43,773 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e09c68ec302b1f6c394a5916c202763d: 2023-07-14 09:12:43,773 DEBUG [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2f3f8339e05d5c6e05e790598e309e26: 2023-07-14 09:12:43,774 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689325962278.e09c68ec302b1f6c394a5916c202763d.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,774 DEBUG [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689325962278.2f3f8339e05d5c6e05e790598e309e26.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,779 DEBUG [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 09:12:43,779 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 09:12:43,783 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 09:12:43,783 DEBUG [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 09:12:43,784 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:12:43,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 09:12:43,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:12:43,789 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 09:12:43,817 DEBUG [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689325962278.2f3f8339e05d5c6e05e790598e309e26. completed. 2023-07-14 09:12:43,817 DEBUG [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689325962278.2f3f8339e05d5c6e05e790598e309e26. 2023-07-14 09:12:43,818 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 09:12:43,818 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 09:12:43,818 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:12:43,818 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-14 09:12:43,818 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,41875,1689325950034' in zk 2023-07-14 09:12:43,822 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-14 09:12:43,822 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:12:43,822 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:12:43,822 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-14 09:12:43,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:12:43,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:12:43,825 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689325962278.e09c68ec302b1f6c394a5916c202763d. completed. 2023-07-14 09:12:43,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:12:43,827 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689325962278.e09c68ec302b1f6c394a5916c202763d. 2023-07-14 09:12:43,827 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 09:12:43,827 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 09:12:43,827 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:12:43,827 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-14 09:12:43,827 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,45899,1689325949913' in zk 2023-07-14 09:12:43,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:12:43,832 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:12:43,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:12:43,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:12:43,833 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-14 09:12:43,834 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:12:43,834 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-14 09:12:43,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:12:43,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:12:43,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:12:43,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:12:43,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:12:43,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:12:43,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,41875,1689325950034': 2023-07-14 09:12:43,840 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,41875,1689325950034' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-14 09:12:43,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:12:43,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:12:43,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:12:43,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:12:43,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:12:43,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:12:43,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:12:43,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:12:43,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:12:43,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:12:43,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:12:43,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:12:43,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,45899,1689325949913': 2023-07-14 09:12:43,847 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45899,1689325949913' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-14 09:12:43,847 INFO [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-14 09:12:43,847 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 09:12:43,847 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 09:12:43,847 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,847 INFO [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 09:12:43,850 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,851 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,851 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:12:43,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,851 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:12:43,851 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,851 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:12:43,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:12:43,851 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:12:43,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,852 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:12:43,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:12:43,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:12:43,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:12:43,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:12:43,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:12:43,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:12:43,853 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:12:43,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:12:43,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,854 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:12:43,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:12:43,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:12:43,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:12:43,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:12:43,857 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:12:43,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:12:43,857 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:12:43,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,858 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:12:43,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:12:43,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:12:43,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:12:43,872 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:12:43,872 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:12:43,872 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:12:43,872 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:12:43,872 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:12:43,872 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:12:43,872 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:12:43,873 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,873 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:12:43,872 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:12:43,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:12:43,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:12:43,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:12:43,874 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-14 09:12:43,873 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:12:43,874 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:12:43,874 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,874 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:12:43,874 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,874 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:12:43,874 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:12:43,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:12:43,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:12:43,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:12:43,874 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,874 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,874 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,875 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-14 09:12:43,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:12:43,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:12:43,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:12:43,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:12:43,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:12:43,876 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-14 09:12:43,898 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,901 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,967 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,989 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:12:43,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 09:12:43,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:12:43,993 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 09:12:44,024 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-14 09:12:44,024 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:44,024 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:44,025 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689325963676Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689325963898 (+222 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689325963898Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689325963898Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689325963913 (+15 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689325963950 (+37 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689325964024 (+74 ms) 2023-07-14 09:12:44,026 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-14 09:12:44,030 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 348 msec 2023-07-14 09:12:44,293 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:12:44,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 09:12:44,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 09:12:44,312 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45899] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689325962278.e09c68ec302b1f6c394a5916c202763d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 09:12:44,314 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41875] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689325962278.2f3f8339e05d5c6e05e790598e309e26. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 09:12:44,319 DEBUG [Listener at jenkins-hbase9.apache.org/45395] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-14 09:12:44,320 DEBUG [Listener at jenkins-hbase9.apache.org/45395] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689325962278.e09c68ec302b1f6c394a5916c202763d. 2023-07-14 09:12:44,320 INFO [Listener at jenkins-hbase9.apache.org/45395] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 09:12:44,339 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-14 09:12:44,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689325964339 (current time:1689325964339). 2023-07-14 09:12:44,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 09:12:44,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] zookeeper.ReadOnlyZKClient(139): Connect 0x69347da3 to 127.0.0.1:59920 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:12:44,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a6efe75, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:12:44,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:12:44,352 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:36060, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:12:44,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x69347da3 to 127.0.0.1:59920 2023-07-14 09:12:44,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:12:44,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] zookeeper.ReadOnlyZKClient(139): Connect 0x65d6dc9e to 127.0.0.1:59920 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:12:44,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f456ce2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:12:44,364 DEBUG [hconnection-0x32c5a229-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:12:44,366 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:36064, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:12:44,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:12:44,374 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:35808, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:12:44,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x65d6dc9e to 127.0.0.1:59920 2023-07-14 09:12:44,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:12:44,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-14 09:12:44,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 09:12:44,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-14 09:12:44,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-14 09:12:44,381 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-14 09:12:44,382 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689326564382 2023-07-14 09:12:44,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-14 09:12:44,382 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-14 09:12:44,383 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 09:12:44,383 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 09:12:44,384 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-14 09:12:44,384 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-14 09:12:44,386 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-07-14 09:12:44,387 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-14 09:12:44,389 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689326564389 2023-07-14 09:12:44,403 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-14 09:12:44,403 INFO [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-14 09:12:44,403 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:12:44,404 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-14 09:12:44,404 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-14 09:12:44,404 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,404 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,406 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:12:44,406 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:12:44,406 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:12:44,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:12:44,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:12:44,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:12:44,406 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:12:44,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:12:44,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:12:44,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:12:44,406 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:12:44,406 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:12:44,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,407 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:12:44,407 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 09:12:44,407 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,407 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,407 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-14 09:12:44,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,408 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-14 09:12:44,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-14 09:12:44,408 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-14 09:12:44,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,408 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-14 09:12:44,408 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:12:44,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-14 09:12:44,408 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-14 09:12:44,409 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-14 09:12:44,409 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-14 09:12:44,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,409 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41875,1689325950034' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-14 09:12:44,409 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-14 09:12:44,409 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-14 09:12:44,409 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-14 09:12:44,409 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-14 09:12:44,410 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:12:44,410 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-14 09:12:44,410 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:12:44,410 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-14 09:12:44,411 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-14 09:12:44,411 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-14 09:12:44,411 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-14 09:12:44,411 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,37313,1689325949765' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-14 09:12:44,411 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45899,1689325949913' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-14 09:12:44,412 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:12:44,412 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:12:44,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:12:44,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:12:44,414 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,415 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:12:44,415 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,415 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:12:44,415 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,415 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:12:44,415 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:12:44,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:12:44,416 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,416 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:12:44,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 09:12:44,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:12:44,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:12:44,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:12:44,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:12:44,418 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,41875,1689325950034' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-14 09:12:44,418 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@14cf10c7[Count = 1] remaining members to acquire global barrier 2023-07-14 09:12:44,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:12:44,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:12:44,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:12:44,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:12:44,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:12:44,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 09:12:44,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:12:44,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:12:44,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:12:44,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:12:44,420 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45899,1689325949913' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-14 09:12:44,420 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@14cf10c7[Count = 0] remaining members to acquire global barrier 2023-07-14 09:12:44,420 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-14 09:12:44,421 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,428 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,428 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,428 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,428 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-14 09:12:44,428 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-14 09:12:44,428 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:12:44,428 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-14 09:12:44,428 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,37313,1689325949765' in zk 2023-07-14 09:12:44,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,428 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 09:12:44,429 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 09:12:44,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,429 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689325962278.e09c68ec302b1f6c394a5916c202763d. 2023-07-14 09:12:44,429 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-14 09:12:44,429 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689325962278.e09c68ec302b1f6c394a5916c202763d. started... 2023-07-14 09:12:44,429 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:12:44,429 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 09:12:44,429 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 09:12:44,429 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 09:12:44,429 INFO [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e09c68ec302b1f6c394a5916c202763d 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-14 09:12:44,429 DEBUG [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689325962278.2f3f8339e05d5c6e05e790598e309e26. 2023-07-14 09:12:44,429 DEBUG [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689325962278.2f3f8339e05d5c6e05e790598e309e26. started... 2023-07-14 09:12:44,429 INFO [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2f3f8339e05d5c6e05e790598e309e26 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-14 09:12:44,436 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-14 09:12:44,436 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:12:44,436 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-14 09:12:44,483 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:12:44,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 09:12:44,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:12:44,485 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 09:12:44,554 INFO [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230714a762e22935bd47ce81cd4e1163aad434 to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230714a762e22935bd47ce81cd4e1163aad434 2023-07-14 09:12:44,554 INFO [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307141d733f0eeb2e4f5ba63936754bb91044 to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307141d733f0eeb2e4f5ba63936754bb91044 2023-07-14 09:12:44,599 INFO [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportWithTargetName/2f3f8339e05d5c6e05e790598e309e26/.tmp/cf/690714eb01314e04b82ec106c21f310d 2023-07-14 09:12:44,610 DEBUG [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportWithTargetName/2f3f8339e05d5c6e05e790598e309e26/.tmp/cf/690714eb01314e04b82ec106c21f310d as hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportWithTargetName/2f3f8339e05d5c6e05e790598e309e26/cf/690714eb01314e04b82ec106c21f310d 2023-07-14 09:12:44,618 INFO [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportWithTargetName/2f3f8339e05d5c6e05e790598e309e26/cf/690714eb01314e04b82ec106c21f310d, entries=45, sequenceid=6, filesize=12.5 K 2023-07-14 09:12:44,621 INFO [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 2f3f8339e05d5c6e05e790598e309e26 in 192ms, sequenceid=6, compaction requested=false 2023-07-14 09:12:44,621 DEBUG [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-14 09:12:44,622 DEBUG [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2f3f8339e05d5c6e05e790598e309e26: 2023-07-14 09:12:44,622 DEBUG [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689325962278.2f3f8339e05d5c6e05e790598e309e26.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-14 09:12:44,622 DEBUG [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 09:12:44,623 DEBUG [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportWithTargetName/2f3f8339e05d5c6e05e790598e309e26/cf/690714eb01314e04b82ec106c21f310d] hfiles 2023-07-14 09:12:44,623 DEBUG [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportWithTargetName/2f3f8339e05d5c6e05e790598e309e26/cf/690714eb01314e04b82ec106c21f310d for snapshot=snaptb0-testExportWithTargetName 2023-07-14 09:12:44,651 DEBUG [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689325962278.2f3f8339e05d5c6e05e790598e309e26. completed. 2023-07-14 09:12:44,651 DEBUG [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689325962278.2f3f8339e05d5c6e05e790598e309e26. 2023-07-14 09:12:44,652 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 09:12:44,653 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 09:12:44,653 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:12:44,653 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-14 09:12:44,653 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,41875,1689325950034' in zk 2023-07-14 09:12:44,656 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-14 09:12:44,656 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:12:44,656 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:12:44,656 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-14 09:12:44,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:12:44,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:12:44,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:12:44,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:12:44,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:12:44,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 09:12:44,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:12:44,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:12:44,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:12:44,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:12:44,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 09:12:44,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:12:44,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:12:44,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,41875,1689325950034': 2023-07-14 09:12:44,665 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,41875,1689325950034' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-14 09:12:44,685 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:12:44,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 09:12:44,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:12:44,688 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 09:12:44,988 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:12:44,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 09:12:44,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:12:44,990 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-14 09:12:45,000 INFO [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportWithTargetName/e09c68ec302b1f6c394a5916c202763d/.tmp/cf/880487e67e3c4575a62da23a10d258fe 2023-07-14 09:12:45,013 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportWithTargetName/e09c68ec302b1f6c394a5916c202763d/.tmp/cf/880487e67e3c4575a62da23a10d258fe as hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportWithTargetName/e09c68ec302b1f6c394a5916c202763d/cf/880487e67e3c4575a62da23a10d258fe 2023-07-14 09:12:45,023 INFO [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportWithTargetName/e09c68ec302b1f6c394a5916c202763d/cf/880487e67e3c4575a62da23a10d258fe, entries=5, sequenceid=6, filesize=5.7 K 2023-07-14 09:12:45,028 INFO [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for e09c68ec302b1f6c394a5916c202763d in 599ms, sequenceid=6, compaction requested=false 2023-07-14 09:12:45,030 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e09c68ec302b1f6c394a5916c202763d: 2023-07-14 09:12:45,030 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689325962278.e09c68ec302b1f6c394a5916c202763d.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-14 09:12:45,030 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 09:12:45,030 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportWithTargetName/e09c68ec302b1f6c394a5916c202763d/cf/880487e67e3c4575a62da23a10d258fe] hfiles 2023-07-14 09:12:45,030 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportWithTargetName/e09c68ec302b1f6c394a5916c202763d/cf/880487e67e3c4575a62da23a10d258fe for snapshot=snaptb0-testExportWithTargetName 2023-07-14 09:12:45,092 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689325962278.e09c68ec302b1f6c394a5916c202763d. completed. 2023-07-14 09:12:45,092 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689325962278.e09c68ec302b1f6c394a5916c202763d. 2023-07-14 09:12:45,092 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 09:12:45,094 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 09:12:45,094 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:12:45,094 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-14 09:12:45,094 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,45899,1689325949913' in zk 2023-07-14 09:12:45,097 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-14 09:12:45,097 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:12:45,097 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:12:45,097 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-14 09:12:45,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:12:45,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:12:45,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:12:45,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:12:45,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:12:45,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 09:12:45,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:12:45,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:12:45,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:12:45,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:12:45,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 09:12:45,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:12:45,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:12:45,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:12:45,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,45899,1689325949913': 2023-07-14 09:12:45,104 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45899,1689325949913' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-14 09:12:45,104 INFO [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-14 09:12:45,104 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 09:12:45,104 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 09:12:45,104 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-14 09:12:45,104 INFO [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 09:12:45,106 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 09:12:45,106 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 09:12:45,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 09:12:45,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 09:12:45,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:12:45,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:12:45,106 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:12:45,106 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 09:12:45,106 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 09:12:45,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 09:12:45,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 09:12:45,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 09:12:45,106 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:12:45,106 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:12:45,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 09:12:45,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:12:45,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 09:12:45,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:12:45,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:12:45,107 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:12:45,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:12:45,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 09:12:45,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:12:45,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:12:45,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:12:45,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 09:12:45,109 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:12:45,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 09:12:45,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:12:45,110 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:12:45,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 09:12:45,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 09:12:45,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:12:45,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:12:45,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:12:45,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:12:45,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 09:12:45,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:12:45,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:12:45,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:12:45,123 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:12:45,125 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:12:45,125 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:12:45,153 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:12:45,153 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 09:12:45,153 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:12:45,154 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:12:45,154 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:12:45,154 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:12:45,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:12:45,154 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-14 09:12:45,154 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:12:45,154 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-14 09:12:45,154 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 09:12:45,155 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-14 09:12:45,154 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:12:45,156 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-14 09:12:45,156 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:12:45,154 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:12:45,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:12:45,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:12:45,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:12:45,156 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:12:45,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:12:45,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:12:45,155 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:12:45,156 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 09:12:45,156 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:12:45,156 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:12:45,156 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 09:12:45,156 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 09:12:45,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:12:45,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:12:45,157 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:12:45,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:12:45,157 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:12:45,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:12:45,158 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307141d733f0eeb2e4f5ba63936754bb91044, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230714a762e22935bd47ce81cd4e1163aad434] mob files 2023-07-14 09:12:45,158 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307141d733f0eeb2e4f5ba63936754bb91044 2023-07-14 09:12:45,158 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230714a762e22935bd47ce81cd4e1163aad434 2023-07-14 09:12:45,183 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-14 09:12:45,184 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-14 09:12:45,248 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-14 09:12:45,341 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-14 09:12:45,341 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-14 09:12:45,342 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-14 09:12:45,342 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689325964382Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689325965183 (+801 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1689325965183Loading Region manifests for snaptb0-testExportWithTargetName at 1689325965183Writing data manifest for snaptb0-testExportWithTargetName at 1689325965190 (+7 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689325965236 (+46 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689325965341 (+105 ms) 2023-07-14 09:12:45,345 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-14 09:12:45,349 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 964 msec 2023-07-14 09:12:45,490 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:12:45,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 09:12:45,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 09:12:45,495 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/export-test/export-1689325965495 2023-07-14 09:12:45,495 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43771, tgtDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/export-test/export-1689325965495, rawTgtDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/export-test/export-1689325965495, srcFsUri=hdfs://localhost:43771, srcDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8 2023-07-14 09:12:45,544 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43771, inputRoot=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8 2023-07-14 09:12:45,544 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1348919463_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/export-test/export-1689325965495, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/export-test/export-1689325965495/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-14 09:12:45,544 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43771, inputRoot=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8, snapshotDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-14 09:12:45,586 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/export-test/export-1689325965495/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-14 09:12:45,715 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 09:12:45,716 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 09:12:45,716 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 09:12:45,717 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 09:12:45,717 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-14 09:12:45,718 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 09:12:45,718 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 09:12:45,815 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/hadoop-8318507669852901251.jar 2023-07-14 09:12:45,816 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 09:12:45,816 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 09:12:45,817 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 09:12:45,818 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 09:12:45,818 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 09:12:45,818 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 09:12:45,819 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 09:12:45,820 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 09:12:45,820 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 09:12:45,820 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 09:12:45,821 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 09:12:45,822 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 09:12:45,822 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 09:12:45,822 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 09:12:45,823 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 09:12:45,823 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 09:12:45,827 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:12:45,827 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:12:45,828 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 09:12:45,828 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:12:45,829 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:12:45,829 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 09:12:45,830 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 09:12:46,834 WARN [Listener at jenkins-hbase9.apache.org/45395] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 09:12:46,840 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-14 09:12:46,849 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-14 09:12:47,434 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 09:12:47,437 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 09:12:47,973 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960675_0001_000001 (auth:SIMPLE) 2023-07-14 09:12:48,479 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 09:12:55,220 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960675_0001_000001 (auth:SIMPLE) 2023-07-14 09:12:57,550 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960675_0001_000001 (auth:SIMPLE) 2023-07-14 09:13:02,895 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 09:13:02,897 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 09:13:02,914 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-14 09:13:02,914 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 09:13:02,915 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 09:13:02,915 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2112291524_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-14 09:13:02,916 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(367): hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-14 09:13:02,916 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(367): hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-14 09:13:02,916 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2112291524_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/export-test/export-1689325965495/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/export-test/export-1689325965495/.hbase-snapshot/testExportWithTargetName 2023-07-14 09:13:02,916 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(367): hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/export-test/export-1689325965495/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-14 09:13:02,916 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(367): hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/export-test/export-1689325965495/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-14 09:13:02,927 INFO [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-14 09:13:02,932 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportWithTargetName 2023-07-14 09:13:02,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-14 09:13:02,945 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689325982944"}]},"ts":"1689325982944"} 2023-07-14 09:13:02,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-14 09:13:02,946 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-14 09:13:02,949 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-14 09:13:02,951 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e09c68ec302b1f6c394a5916c202763d, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2f3f8339e05d5c6e05e790598e309e26, UNASSIGN}] 2023-07-14 09:13:02,953 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e09c68ec302b1f6c394a5916c202763d, UNASSIGN 2023-07-14 09:13:02,953 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2f3f8339e05d5c6e05e790598e309e26, UNASSIGN 2023-07-14 09:13:02,954 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=e09c68ec302b1f6c394a5916c202763d, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:02,955 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=2f3f8339e05d5c6e05e790598e309e26, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:13:02,955 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689325962278.e09c68ec302b1f6c394a5916c202763d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689325982954"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689325982954"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689325982954"}]},"ts":"1689325982954"} 2023-07-14 09:13:02,955 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689325962278.2f3f8339e05d5c6e05e790598e309e26.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689325982954"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689325982954"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689325982954"}]},"ts":"1689325982954"} 2023-07-14 09:13:02,957 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure e09c68ec302b1f6c394a5916c202763d, server=jenkins-hbase9.apache.org,45899,1689325949913}] 2023-07-14 09:13:02,957 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 2f3f8339e05d5c6e05e790598e309e26, server=jenkins-hbase9.apache.org,41875,1689325950034}] 2023-07-14 09:13:03,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-14 09:13:03,117 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 2f3f8339e05d5c6e05e790598e309e26 2023-07-14 09:13:03,117 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close e09c68ec302b1f6c394a5916c202763d 2023-07-14 09:13:03,117 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 2f3f8339e05d5c6e05e790598e309e26, disabling compactions & flushes 2023-07-14 09:13:03,117 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing e09c68ec302b1f6c394a5916c202763d, disabling compactions & flushes 2023-07-14 09:13:03,117 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689325962278.2f3f8339e05d5c6e05e790598e309e26. 2023-07-14 09:13:03,117 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689325962278.e09c68ec302b1f6c394a5916c202763d. 2023-07-14 09:13:03,117 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689325962278.2f3f8339e05d5c6e05e790598e309e26. 2023-07-14 09:13:03,117 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689325962278.e09c68ec302b1f6c394a5916c202763d. 2023-07-14 09:13:03,117 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689325962278.2f3f8339e05d5c6e05e790598e309e26. after waiting 0 ms 2023-07-14 09:13:03,117 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689325962278.e09c68ec302b1f6c394a5916c202763d. after waiting 0 ms 2023-07-14 09:13:03,117 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689325962278.2f3f8339e05d5c6e05e790598e309e26. 2023-07-14 09:13:03,117 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689325962278.e09c68ec302b1f6c394a5916c202763d. 2023-07-14 09:13:03,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportWithTargetName/2f3f8339e05d5c6e05e790598e309e26/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 09:13:03,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportWithTargetName/e09c68ec302b1f6c394a5916c202763d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 09:13:03,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 09:13:03,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 09:13:03,140 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689325962278.2f3f8339e05d5c6e05e790598e309e26. 2023-07-14 09:13:03,140 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689325962278.e09c68ec302b1f6c394a5916c202763d. 2023-07-14 09:13:03,140 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 2f3f8339e05d5c6e05e790598e309e26: 2023-07-14 09:13:03,140 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for e09c68ec302b1f6c394a5916c202763d: 2023-07-14 09:13:03,142 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed e09c68ec302b1f6c394a5916c202763d 2023-07-14 09:13:03,143 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=e09c68ec302b1f6c394a5916c202763d, regionState=CLOSED 2023-07-14 09:13:03,143 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689325962278.e09c68ec302b1f6c394a5916c202763d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689325983143"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689325983143"}]},"ts":"1689325983143"} 2023-07-14 09:13:03,145 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=2f3f8339e05d5c6e05e790598e309e26, regionState=CLOSED 2023-07-14 09:13:03,145 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 2f3f8339e05d5c6e05e790598e309e26 2023-07-14 09:13:03,145 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689325962278.2f3f8339e05d5c6e05e790598e309e26.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689325983145"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689325983145"}]},"ts":"1689325983145"} 2023-07-14 09:13:03,150 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-14 09:13:03,150 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure e09c68ec302b1f6c394a5916c202763d, server=jenkins-hbase9.apache.org,45899,1689325949913 in 189 msec 2023-07-14 09:13:03,151 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-14 09:13:03,151 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 2f3f8339e05d5c6e05e790598e309e26, server=jenkins-hbase9.apache.org,41875,1689325950034 in 191 msec 2023-07-14 09:13:03,153 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e09c68ec302b1f6c394a5916c202763d, UNASSIGN in 199 msec 2023-07-14 09:13:03,155 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=21 2023-07-14 09:13:03,155 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2f3f8339e05d5c6e05e790598e309e26, UNASSIGN in 200 msec 2023-07-14 09:13:03,156 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689325983156"}]},"ts":"1689325983156"} 2023-07-14 09:13:03,158 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-14 09:13:03,164 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-14 09:13:03,169 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 232 msec 2023-07-14 09:13:03,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-14 09:13:03,248 INFO [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-14 09:13:03,254 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportWithTargetName 2023-07-14 09:13:03,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-14 09:13:03,268 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-14 09:13:03,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-14 09:13:03,271 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-14 09:13:03,276 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41875] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-14 09:13:03,280 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-14 09:13:03,280 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-14 09:13:03,280 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-14 09:13:03,280 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-14 09:13:03,280 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportWithTargetName/e09c68ec302b1f6c394a5916c202763d 2023-07-14 09:13:03,283 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportWithTargetName/2f3f8339e05d5c6e05e790598e309e26 2023-07-14 09:13:03,284 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:13:03,284 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-14 09:13:03,284 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-14 09:13:03,284 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:13:03,284 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:13:03,284 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-14 09:13:03,284 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-14 09:13:03,284 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:13:03,285 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-14 09:13:03,285 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-14 09:13:03,287 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-14 09:13:03,287 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-14 09:13:03,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-14 09:13:03,291 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportWithTargetName/e09c68ec302b1f6c394a5916c202763d/cf, FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportWithTargetName/e09c68ec302b1f6c394a5916c202763d/recovered.edits] 2023-07-14 09:13:03,291 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportWithTargetName/2f3f8339e05d5c6e05e790598e309e26/cf, FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportWithTargetName/2f3f8339e05d5c6e05e790598e309e26/recovered.edits] 2023-07-14 09:13:03,303 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportWithTargetName/2f3f8339e05d5c6e05e790598e309e26/cf/690714eb01314e04b82ec106c21f310d to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/archive/data/default/testtb-testExportWithTargetName/2f3f8339e05d5c6e05e790598e309e26/cf/690714eb01314e04b82ec106c21f310d 2023-07-14 09:13:03,303 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportWithTargetName/e09c68ec302b1f6c394a5916c202763d/cf/880487e67e3c4575a62da23a10d258fe to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/archive/data/default/testtb-testExportWithTargetName/e09c68ec302b1f6c394a5916c202763d/cf/880487e67e3c4575a62da23a10d258fe 2023-07-14 09:13:03,315 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportWithTargetName/e09c68ec302b1f6c394a5916c202763d/recovered.edits/9.seqid to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/archive/data/default/testtb-testExportWithTargetName/e09c68ec302b1f6c394a5916c202763d/recovered.edits/9.seqid 2023-07-14 09:13:03,315 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportWithTargetName/2f3f8339e05d5c6e05e790598e309e26/recovered.edits/9.seqid to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/archive/data/default/testtb-testExportWithTargetName/2f3f8339e05d5c6e05e790598e309e26/recovered.edits/9.seqid 2023-07-14 09:13:03,316 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportWithTargetName/e09c68ec302b1f6c394a5916c202763d 2023-07-14 09:13:03,316 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportWithTargetName/2f3f8339e05d5c6e05e790598e309e26 2023-07-14 09:13:03,317 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-14 09:13:03,317 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-14 09:13:03,319 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-14 09:13:03,328 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307141d733f0eeb2e4f5ba63936754bb91044 to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307141d733f0eeb2e4f5ba63936754bb91044 2023-07-14 09:13:03,330 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230714a762e22935bd47ce81cd4e1163aad434 to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230714a762e22935bd47ce81cd4e1163aad434 2023-07-14 09:13:03,331 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-14 09:13:03,334 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-14 09:13:03,369 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-14 09:13:03,373 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-14 09:13:03,375 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-14 09:13:03,375 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-14 09:13:03,375 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689325962278.e09c68ec302b1f6c394a5916c202763d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689325983375"}]},"ts":"9223372036854775807"} 2023-07-14 09:13:03,375 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689325962278.2f3f8339e05d5c6e05e790598e309e26.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689325983375"}]},"ts":"9223372036854775807"} 2023-07-14 09:13:03,378 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 09:13:03,378 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e09c68ec302b1f6c394a5916c202763d, NAME => 'testtb-testExportWithTargetName,,1689325962278.e09c68ec302b1f6c394a5916c202763d.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 2f3f8339e05d5c6e05e790598e309e26, NAME => 'testtb-testExportWithTargetName,1,1689325962278.2f3f8339e05d5c6e05e790598e309e26.', STARTKEY => '1', ENDKEY => ''}] 2023-07-14 09:13:03,378 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-14 09:13:03,379 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689325983378"}]},"ts":"9223372036854775807"} 2023-07-14 09:13:03,381 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-14 09:13:03,383 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-14 09:13:03,386 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 128 msec 2023-07-14 09:13:03,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-14 09:13:03,394 INFO [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-14 09:13:03,416 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-14 09:13:03,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-14 09:13:03,423 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportWithTargetName" 2023-07-14 09:13:03,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-14 09:13:03,460 INFO [Listener at jenkins-hbase9.apache.org/45395] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=750 (was 703) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/cluster_57fe12f0-0229-b77c-f9b6-f833c5ee750b/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/cluster_57fe12f0-0229-b77c-f9b6-f833c5ee750b/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/cluster_57fe12f0-0229-b77c-f9b6-f833c5ee750b/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/cluster_57fe12f0-0229-b77c-f9b6-f833c5ee750b/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2112291524_17 at /127.0.0.1:39868 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (130951516) connection to jenkins-hbase9.apache.org/172.31.2.10:34145 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (130951516) connection to jenkins-hbase9.apache.org/172.31.2.10:45885 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: (jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2112291524_17 at /127.0.0.1:52468 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/cluster_57fe12f0-0229-b77c-f9b6-f833c5ee750b/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6b086784-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6b086784-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1007498124_1 at /127.0.0.1:36664 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2112291524_17 at /127.0.0.1:36694 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6b086784-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1007498124_1 at /127.0.0.1:39834 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/cluster_57fe12f0-0229-b77c-f9b6-f833c5ee750b/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6b086784-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1315 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) - Thread LEAK? -, OpenFileDescriptor=920 (was 899) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=587 (was 672), ProcessCount=190 (was 184) - ProcessCount LEAK? -, AvailableMemoryMB=1763 (was 3521) 2023-07-14 09:13:03,460 WARN [Listener at jenkins-hbase9.apache.org/45395] hbase.ResourceChecker(130): Thread=750 is superior to 500 2023-07-14 09:13:03,489 INFO [Listener at jenkins-hbase9.apache.org/45395] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=750, OpenFileDescriptor=920, MaxFileDescriptor=60000, SystemLoadAverage=587, ProcessCount=190, AvailableMemoryMB=1759 2023-07-14 09:13:03,489 WARN [Listener at jenkins-hbase9.apache.org/45395] hbase.ResourceChecker(130): Thread=750 is superior to 500 2023-07-14 09:13:03,491 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-14 09:13:03,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-14 09:13:03,498 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 09:13:03,500 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-14 09:13:03,500 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 09:13:03,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-14 09:13:03,507 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemState/dc2cb43baee6eae5f97a5e885d7634bf 2023-07-14 09:13:03,522 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemState/dc2cb43baee6eae5f97a5e885d7634bf empty. 2023-07-14 09:13:03,522 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemState/695fe4a0666aa123cdc31ccf977586f0 2023-07-14 09:13:03,522 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemState/dc2cb43baee6eae5f97a5e885d7634bf 2023-07-14 09:13:03,522 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemState/695fe4a0666aa123cdc31ccf977586f0 empty. 2023-07-14 09:13:03,523 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemState/695fe4a0666aa123cdc31ccf977586f0 2023-07-14 09:13:03,523 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-14 09:13:03,543 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-14 09:13:03,544 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => dc2cb43baee6eae5f97a5e885d7634bf, NAME => 'testtb-testExportFileSystemState,,1689325983491.dc2cb43baee6eae5f97a5e885d7634bf.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp 2023-07-14 09:13:03,545 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 695fe4a0666aa123cdc31ccf977586f0, NAME => 'testtb-testExportFileSystemState,1,1689325983491.695fe4a0666aa123cdc31ccf977586f0.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp 2023-07-14 09:13:03,573 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689325983491.dc2cb43baee6eae5f97a5e885d7634bf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:13:03,574 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing dc2cb43baee6eae5f97a5e885d7634bf, disabling compactions & flushes 2023-07-14 09:13:03,574 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689325983491.695fe4a0666aa123cdc31ccf977586f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:13:03,574 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689325983491.dc2cb43baee6eae5f97a5e885d7634bf. 2023-07-14 09:13:03,575 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 695fe4a0666aa123cdc31ccf977586f0, disabling compactions & flushes 2023-07-14 09:13:03,575 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689325983491.dc2cb43baee6eae5f97a5e885d7634bf. 2023-07-14 09:13:03,575 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689325983491.695fe4a0666aa123cdc31ccf977586f0. 2023-07-14 09:13:03,575 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689325983491.dc2cb43baee6eae5f97a5e885d7634bf. after waiting 0 ms 2023-07-14 09:13:03,575 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689325983491.695fe4a0666aa123cdc31ccf977586f0. 2023-07-14 09:13:03,575 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689325983491.dc2cb43baee6eae5f97a5e885d7634bf. 2023-07-14 09:13:03,575 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689325983491.695fe4a0666aa123cdc31ccf977586f0. after waiting 0 ms 2023-07-14 09:13:03,575 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689325983491.dc2cb43baee6eae5f97a5e885d7634bf. 2023-07-14 09:13:03,575 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689325983491.695fe4a0666aa123cdc31ccf977586f0. 2023-07-14 09:13:03,575 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689325983491.695fe4a0666aa123cdc31ccf977586f0. 2023-07-14 09:13:03,575 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for dc2cb43baee6eae5f97a5e885d7634bf: 2023-07-14 09:13:03,575 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 695fe4a0666aa123cdc31ccf977586f0: 2023-07-14 09:13:03,579 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 09:13:03,580 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689325983491.dc2cb43baee6eae5f97a5e885d7634bf.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689325983580"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689325983580"}]},"ts":"1689325983580"} 2023-07-14 09:13:03,580 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689325983491.695fe4a0666aa123cdc31ccf977586f0.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689325983580"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689325983580"}]},"ts":"1689325983580"} 2023-07-14 09:13:03,584 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 09:13:03,585 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 09:13:03,585 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689325983585"}]},"ts":"1689325983585"} 2023-07-14 09:13:03,587 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-14 09:13:03,591 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 09:13:03,593 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 09:13:03,593 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 09:13:03,593 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 09:13:03,593 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 09:13:03,593 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=dc2cb43baee6eae5f97a5e885d7634bf, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=695fe4a0666aa123cdc31ccf977586f0, ASSIGN}] 2023-07-14 09:13:03,599 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=695fe4a0666aa123cdc31ccf977586f0, ASSIGN 2023-07-14 09:13:03,599 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=dc2cb43baee6eae5f97a5e885d7634bf, ASSIGN 2023-07-14 09:13:03,600 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=695fe4a0666aa123cdc31ccf977586f0, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,37313,1689325949765; forceNewPlan=false, retain=false 2023-07-14 09:13:03,600 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=dc2cb43baee6eae5f97a5e885d7634bf, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45899,1689325949913; forceNewPlan=false, retain=false 2023-07-14 09:13:03,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-14 09:13:03,751 INFO [jenkins-hbase9:41733] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 09:13:03,754 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=695fe4a0666aa123cdc31ccf977586f0, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:03,754 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=dc2cb43baee6eae5f97a5e885d7634bf, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:03,755 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689325983491.dc2cb43baee6eae5f97a5e885d7634bf.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689325983754"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689325983754"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689325983754"}]},"ts":"1689325983754"} 2023-07-14 09:13:03,757 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689325983491.695fe4a0666aa123cdc31ccf977586f0.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689325983754"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689325983754"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689325983754"}]},"ts":"1689325983754"} 2023-07-14 09:13:03,760 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure dc2cb43baee6eae5f97a5e885d7634bf, server=jenkins-hbase9.apache.org,45899,1689325949913}] 2023-07-14 09:13:03,762 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 695fe4a0666aa123cdc31ccf977586f0, server=jenkins-hbase9.apache.org,37313,1689325949765}] 2023-07-14 09:13:03,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-14 09:13:03,923 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:03,923 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-14 09:13:03,924 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689325983491.dc2cb43baee6eae5f97a5e885d7634bf. 2023-07-14 09:13:03,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dc2cb43baee6eae5f97a5e885d7634bf, NAME => 'testtb-testExportFileSystemState,,1689325983491.dc2cb43baee6eae5f97a5e885d7634bf.', STARTKEY => '', ENDKEY => '1'} 2023-07-14 09:13:03,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689325983491.dc2cb43baee6eae5f97a5e885d7634bf. service=AccessControlService 2023-07-14 09:13:03,927 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:51030, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-14 09:13:03,928 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 09:13:03,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState dc2cb43baee6eae5f97a5e885d7634bf 2023-07-14 09:13:03,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689325983491.dc2cb43baee6eae5f97a5e885d7634bf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:13:03,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for dc2cb43baee6eae5f97a5e885d7634bf 2023-07-14 09:13:03,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for dc2cb43baee6eae5f97a5e885d7634bf 2023-07-14 09:13:03,933 INFO [StoreOpener-dc2cb43baee6eae5f97a5e885d7634bf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region dc2cb43baee6eae5f97a5e885d7634bf 2023-07-14 09:13:03,935 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689325983491.695fe4a0666aa123cdc31ccf977586f0. 2023-07-14 09:13:03,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 695fe4a0666aa123cdc31ccf977586f0, NAME => 'testtb-testExportFileSystemState,1,1689325983491.695fe4a0666aa123cdc31ccf977586f0.', STARTKEY => '1', ENDKEY => ''} 2023-07-14 09:13:03,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689325983491.695fe4a0666aa123cdc31ccf977586f0. service=AccessControlService 2023-07-14 09:13:03,936 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 09:13:03,936 DEBUG [StoreOpener-dc2cb43baee6eae5f97a5e885d7634bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemState/dc2cb43baee6eae5f97a5e885d7634bf/cf 2023-07-14 09:13:03,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 695fe4a0666aa123cdc31ccf977586f0 2023-07-14 09:13:03,937 DEBUG [StoreOpener-dc2cb43baee6eae5f97a5e885d7634bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemState/dc2cb43baee6eae5f97a5e885d7634bf/cf 2023-07-14 09:13:03,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689325983491.695fe4a0666aa123cdc31ccf977586f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:13:03,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 695fe4a0666aa123cdc31ccf977586f0 2023-07-14 09:13:03,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 695fe4a0666aa123cdc31ccf977586f0 2023-07-14 09:13:03,937 INFO [StoreOpener-dc2cb43baee6eae5f97a5e885d7634bf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dc2cb43baee6eae5f97a5e885d7634bf columnFamilyName cf 2023-07-14 09:13:03,939 INFO [StoreOpener-695fe4a0666aa123cdc31ccf977586f0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 695fe4a0666aa123cdc31ccf977586f0 2023-07-14 09:13:03,943 INFO [StoreOpener-dc2cb43baee6eae5f97a5e885d7634bf-1] regionserver.HStore(310): Store=dc2cb43baee6eae5f97a5e885d7634bf/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 09:13:03,944 DEBUG [StoreOpener-695fe4a0666aa123cdc31ccf977586f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemState/695fe4a0666aa123cdc31ccf977586f0/cf 2023-07-14 09:13:03,944 DEBUG [StoreOpener-695fe4a0666aa123cdc31ccf977586f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemState/695fe4a0666aa123cdc31ccf977586f0/cf 2023-07-14 09:13:03,945 INFO [StoreOpener-695fe4a0666aa123cdc31ccf977586f0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 695fe4a0666aa123cdc31ccf977586f0 columnFamilyName cf 2023-07-14 09:13:03,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemState/dc2cb43baee6eae5f97a5e885d7634bf 2023-07-14 09:13:03,946 INFO [StoreOpener-695fe4a0666aa123cdc31ccf977586f0-1] regionserver.HStore(310): Store=695fe4a0666aa123cdc31ccf977586f0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 09:13:03,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemState/dc2cb43baee6eae5f97a5e885d7634bf 2023-07-14 09:13:03,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemState/695fe4a0666aa123cdc31ccf977586f0 2023-07-14 09:13:03,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemState/695fe4a0666aa123cdc31ccf977586f0 2023-07-14 09:13:03,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for dc2cb43baee6eae5f97a5e885d7634bf 2023-07-14 09:13:03,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemState/dc2cb43baee6eae5f97a5e885d7634bf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 09:13:03,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 695fe4a0666aa123cdc31ccf977586f0 2023-07-14 09:13:03,954 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened dc2cb43baee6eae5f97a5e885d7634bf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72996205, jitterRate=0.08772821724414825}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 09:13:03,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for dc2cb43baee6eae5f97a5e885d7634bf: 2023-07-14 09:13:03,957 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689325983491.dc2cb43baee6eae5f97a5e885d7634bf., pid=30, masterSystemTime=1689325983917 2023-07-14 09:13:03,959 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemState/695fe4a0666aa123cdc31ccf977586f0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 09:13:03,960 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 695fe4a0666aa123cdc31ccf977586f0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71891275, jitterRate=0.07126347720623016}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 09:13:03,960 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 695fe4a0666aa123cdc31ccf977586f0: 2023-07-14 09:13:03,962 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689325983491.695fe4a0666aa123cdc31ccf977586f0., pid=31, masterSystemTime=1689325983923 2023-07-14 09:13:03,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689325983491.dc2cb43baee6eae5f97a5e885d7634bf. 2023-07-14 09:13:03,965 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689325983491.dc2cb43baee6eae5f97a5e885d7634bf. 2023-07-14 09:13:03,966 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=dc2cb43baee6eae5f97a5e885d7634bf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:03,966 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689325983491.dc2cb43baee6eae5f97a5e885d7634bf.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689325983966"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689325983966"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689325983966"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689325983966"}]},"ts":"1689325983966"} 2023-07-14 09:13:03,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689325983491.695fe4a0666aa123cdc31ccf977586f0. 2023-07-14 09:13:03,969 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689325983491.695fe4a0666aa123cdc31ccf977586f0. 2023-07-14 09:13:03,970 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=695fe4a0666aa123cdc31ccf977586f0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:03,971 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689325983491.695fe4a0666aa123cdc31ccf977586f0.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689325983970"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689325983970"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689325983970"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689325983970"}]},"ts":"1689325983970"} 2023-07-14 09:13:03,974 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=28 2023-07-14 09:13:03,974 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure dc2cb43baee6eae5f97a5e885d7634bf, server=jenkins-hbase9.apache.org,45899,1689325949913 in 211 msec 2023-07-14 09:13:03,976 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-07-14 09:13:03,977 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 695fe4a0666aa123cdc31ccf977586f0, server=jenkins-hbase9.apache.org,37313,1689325949765 in 211 msec 2023-07-14 09:13:03,977 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=dc2cb43baee6eae5f97a5e885d7634bf, ASSIGN in 381 msec 2023-07-14 09:13:03,979 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-07-14 09:13:03,979 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=695fe4a0666aa123cdc31ccf977586f0, ASSIGN in 384 msec 2023-07-14 09:13:03,980 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 09:13:03,980 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689325983980"}]},"ts":"1689325983980"} 2023-07-14 09:13:03,982 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-14 09:13:03,984 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 09:13:03,985 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-14 09:13:03,987 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41875] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-14 09:13:03,990 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:13:03,990 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:13:03,990 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:13:03,990 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:13:03,991 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 09:13:03,991 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 09:13:03,991 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 09:13:03,991 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 09:13:03,993 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 498 msec 2023-07-14 09:13:04,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-14 09:13:04,105 INFO [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-14 09:13:04,108 DEBUG [Listener at jenkins-hbase9.apache.org/45395] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-14 09:13:04,108 DEBUG [Listener at jenkins-hbase9.apache.org/45395] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689325983491.dc2cb43baee6eae5f97a5e885d7634bf. 2023-07-14 09:13:04,110 INFO [Listener at jenkins-hbase9.apache.org/45395] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 09:13:04,120 DEBUG [hconnection-0x570f5d1d-shared-pool-11] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:13:04,124 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:51034, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:13:04,128 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 09:13:04,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689325984128 (current time:1689325984128). 2023-07-14 09:13:04,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 09:13:04,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] zookeeper.ReadOnlyZKClient(139): Connect 0x3a7bfbae to 127.0.0.1:59920 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:13:04,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@49a397a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:13:04,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:13:04,137 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:53902, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:13:04,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3a7bfbae to 127.0.0.1:59920 2023-07-14 09:13:04,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:13:04,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] zookeeper.ReadOnlyZKClient(139): Connect 0x2940a2af to 127.0.0.1:59920 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:13:04,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c039aa2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:13:04,145 DEBUG [hconnection-0x19072bb1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:13:04,148 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:53906, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:13:04,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:13:04,153 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:49350, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:13:04,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2940a2af to 127.0.0.1:59920 2023-07-14 09:13:04,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:13:04,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-14 09:13:04,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 09:13:04,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 09:13:04,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-14 09:13:04,159 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-14 09:13:04,160 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689326584160 2023-07-14 09:13:04,160 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-14 09:13:04,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 09:13:04,161 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 09:13:04,162 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 09:13:04,164 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-14 09:13:04,164 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-14 09:13:04,168 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-07-14 09:13:04,168 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-14 09:13:04,170 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689326584170 2023-07-14 09:13:04,187 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,187 INFO [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-14 09:13:04,187 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:13:04,189 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-14 09:13:04,189 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-14 09:13:04,189 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,189 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,191 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:13:04,191 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:13:04,191 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:04,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:13:04,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:13:04,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:13:04,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:13:04,191 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:13:04,192 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:04,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:13:04,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:13:04,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,192 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:04,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,193 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,193 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,193 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:04,193 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 09:13:04,193 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-14 09:13:04,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-14 09:13:04,193 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-14 09:13:04,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,194 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-14 09:13:04,195 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,195 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-14 09:13:04,195 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:13:04,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-14 09:13:04,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,198 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-14 09:13:04,198 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,199 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,200 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-14 09:13:04,200 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-14 09:13:04,200 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:13:04,199 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-14 09:13:04,201 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-14 09:13:04,201 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-14 09:13:04,201 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-14 09:13:04,200 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:13:04,201 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45899,1689325949913' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-14 09:13:04,201 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41875,1689325950034' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-14 09:13:04,202 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-14 09:13:04,202 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-14 09:13:04,202 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,37313,1689325949765' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-14 09:13:04,208 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,208 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,208 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:04,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:04,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:13:04,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:13:04,208 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,208 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:13:04,208 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,208 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:13:04,208 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:04,209 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:13:04,209 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:13:04,209 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:13:04,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:13:04,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:04,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:04,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:13:04,211 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45899,1689325949913' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-14 09:13:04,211 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f4b5711[Count = 1] remaining members to acquire global barrier 2023-07-14 09:13:04,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:04,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:13:04,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:13:04,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:13:04,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:13:04,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:13:04,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:04,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:04,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:13:04,214 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,37313,1689325949765' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-14 09:13:04,214 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f4b5711[Count = 0] remaining members to acquire global barrier 2023-07-14 09:13:04,214 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-14 09:13:04,214 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,216 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,216 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-14 09:13:04,216 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:04,216 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 09:13:04,217 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 09:13:04,217 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,217 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689325983491.dc2cb43baee6eae5f97a5e885d7634bf. 2023-07-14 09:13:04,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,217 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689325983491.dc2cb43baee6eae5f97a5e885d7634bf. started... 2023-07-14 09:13:04,217 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:04,217 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 09:13:04,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,217 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-14 09:13:04,217 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dc2cb43baee6eae5f97a5e885d7634bf: 2023-07-14 09:13:04,217 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 09:13:04,217 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689325983491.dc2cb43baee6eae5f97a5e885d7634bf.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,217 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689325983491.695fe4a0666aa123cdc31ccf977586f0. 2023-07-14 09:13:04,217 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 09:13:04,218 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,217 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689325983491.695fe4a0666aa123cdc31ccf977586f0. started... 2023-07-14 09:13:04,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,217 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 09:13:04,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,219 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 09:13:04,219 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-14 09:13:04,219 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-14 09:13:04,220 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,41875,1689325950034' in zk 2023-07-14 09:13:04,220 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 695fe4a0666aa123cdc31ccf977586f0: 2023-07-14 09:13:04,221 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689325983491.695fe4a0666aa123cdc31ccf977586f0.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,221 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 09:13:04,221 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 09:13:04,221 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-14 09:13:04,221 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:13:04,221 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-14 09:13:04,245 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689325983491.dc2cb43baee6eae5f97a5e885d7634bf. completed. 2023-07-14 09:13:04,245 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689325983491.695fe4a0666aa123cdc31ccf977586f0. completed. 2023-07-14 09:13:04,245 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689325983491.695fe4a0666aa123cdc31ccf977586f0. 2023-07-14 09:13:04,245 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689325983491.dc2cb43baee6eae5f97a5e885d7634bf. 2023-07-14 09:13:04,246 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 09:13:04,246 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 09:13:04,246 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:04,246 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 09:13:04,246 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 09:13:04,246 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-14 09:13:04,246 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:04,246 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,45899,1689325949913' in zk 2023-07-14 09:13:04,246 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-14 09:13:04,246 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,37313,1689325949765' in zk 2023-07-14 09:13:04,249 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:04,249 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-14 09:13:04,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:04,249 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:13:04,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:13:04,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:13:04,249 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:04,249 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-14 09:13:04,249 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-14 09:13:04,250 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:13:04,250 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-14 09:13:04,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:13:04,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:13:04,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:13:04,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:04,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:04,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:13:04,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:13:04,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:04,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:04,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,45899,1689325949913': 2023-07-14 09:13:04,257 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45899,1689325949913' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-14 09:13:04,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:04,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:13:04,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:13:04,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:13:04,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:13:04,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:13:04,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:04,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:04,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:13:04,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,262 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:13:04,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:13:04,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:04,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:04,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 09:13:04,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:13:04,264 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 09:13:04,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,37313,1689325949765': 2023-07-14 09:13:04,264 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,37313,1689325949765' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-14 09:13:04,264 INFO [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-14 09:13:04,264 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 09:13:04,264 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 09:13:04,264 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,264 INFO [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 09:13:04,266 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,266 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,266 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,266 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,266 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:13:04,266 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:13:04,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,266 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:13:04,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:13:04,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:13:04,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:13:04,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:13:04,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:13:04,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:13:04,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:13:04,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:13:04,267 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:13:04,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:13:04,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,270 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:04,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:13:04,270 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:04,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:13:04,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:04,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:04,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:13:04,273 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:13:04,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,273 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:04,275 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:04,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:13:04,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:04,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:04,279 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:13:04,279 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:13:04,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:13:04,279 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:13:04,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:13:04,279 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:13:04,279 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:13:04,279 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:04,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:13:04,280 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,279 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:13:04,279 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-14 09:13:04,279 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState because node does not exist (not an error) 2023-07-14 09:13:04,279 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:13:04,280 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,279 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:13:04,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:13:04,281 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-14 09:13:04,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:13:04,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:13:04,280 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:04,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:13:04,282 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:13:04,282 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,282 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:04,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:13:04,282 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:13:04,282 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:04,283 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:13:04,283 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,283 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,283 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-14 09:13:04,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:13:04,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:13:04,317 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,318 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,353 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,440 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-14 09:13:04,440 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,441 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,441 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689325984160Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689325984317 (+157 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689325984317Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689325984317Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689325984323 (+6 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689325984339 (+16 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689325984440 (+101 ms) 2023-07-14 09:13:04,443 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-14 09:13:04,447 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 283 msec 2023-07-14 09:13:04,464 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:13:04,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 09:13:04,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 09:13:04,481 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45899] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689325983491.dc2cb43baee6eae5f97a5e885d7634bf. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 09:13:04,491 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37313] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689325983491.695fe4a0666aa123cdc31ccf977586f0. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 09:13:04,496 DEBUG [Listener at jenkins-hbase9.apache.org/45395] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-14 09:13:04,497 DEBUG [Listener at jenkins-hbase9.apache.org/45395] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689325983491.dc2cb43baee6eae5f97a5e885d7634bf. 2023-07-14 09:13:04,497 INFO [Listener at jenkins-hbase9.apache.org/45395] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 09:13:04,517 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 09:13:04,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689325984517 (current time:1689325984517). 2023-07-14 09:13:04,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 09:13:04,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] zookeeper.ReadOnlyZKClient(139): Connect 0x55ac84fe to 127.0.0.1:59920 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:13:04,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@116d1eda, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:13:04,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:13:04,559 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:53910, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:13:04,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x55ac84fe to 127.0.0.1:59920 2023-07-14 09:13:04,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:13:04,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] zookeeper.ReadOnlyZKClient(139): Connect 0x73cd8085 to 127.0.0.1:59920 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:13:04,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3b953c3c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:13:04,595 DEBUG [hconnection-0x3216e82f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:13:04,596 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:53924, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:13:04,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:13:04,607 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:49354, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:13:04,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x73cd8085 to 127.0.0.1:59920 2023-07-14 09:13:04,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:13:04,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-14 09:13:04,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 09:13:04,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 09:13:04,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-14 09:13:04,614 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-14 09:13:04,615 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689326584615 2023-07-14 09:13:04,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 09:13:04,615 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-14 09:13:04,617 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 09:13:04,617 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 09:13:04,618 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-14 09:13:04,619 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-14 09:13:04,621 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-14 09:13:04,622 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-14 09:13:04,622 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689326584622 2023-07-14 09:13:04,652 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-14 09:13:04,652 INFO [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-14 09:13:04,652 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:13:04,654 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-14 09:13:04,654 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-14 09:13:04,654 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 09:13:04,654 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 09:13:04,656 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:13:04,656 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:13:04,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:13:04,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:13:04,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:13:04,656 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:04,656 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:13:04,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:13:04,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:13:04,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:13:04,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 09:13:04,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 09:13:04,657 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:04,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 09:13:04,657 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:04,657 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 09:13:04,657 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 09:13:04,657 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 09:13:04,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-14 09:13:04,658 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:04,658 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 09:13:04,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 09:13:04,658 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-14 09:13:04,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-14 09:13:04,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 09:13:04,658 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-14 09:13:04,658 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-14 09:13:04,659 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-14 09:13:04,659 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:13:04,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-14 09:13:04,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 09:13:04,659 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-14 09:13:04,661 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-14 09:13:04,665 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-14 09:13:04,666 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-14 09:13:04,666 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-14 09:13:04,666 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:13:04,663 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-14 09:13:04,667 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-14 09:13:04,667 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-14 09:13:04,666 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:13:04,667 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45899,1689325949913' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-14 09:13:04,667 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-14 09:13:04,668 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-14 09:13:04,668 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-14 09:13:04,668 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41875,1689325950034' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-14 09:13:04,668 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,37313,1689325949765' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-14 09:13:04,671 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 09:13:04,671 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:04,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:04,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:13:04,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:13:04,672 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:04,672 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 09:13:04,672 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 09:13:04,673 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 09:13:04,673 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:13:04,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:13:04,673 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 09:13:04,673 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:13:04,673 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 09:13:04,673 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:13:04,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:13:04,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 09:13:04,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:13:04,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:04,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:04,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:13:04,677 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45899,1689325949913' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-14 09:13:04,677 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@536e2117[Count = 1] remaining members to acquire global barrier 2023-07-14 09:13:04,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:04,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:13:04,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:13:04,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:13:04,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:13:04,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 09:13:04,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:13:04,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:04,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:04,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:13:04,680 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,37313,1689325949765' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-14 09:13:04,680 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@536e2117[Count = 0] remaining members to acquire global barrier 2023-07-14 09:13:04,680 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-14 09:13:04,680 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 09:13:04,681 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 09:13:04,681 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 09:13:04,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 09:13:04,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 09:13:04,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 09:13:04,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 09:13:04,681 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 09:13:04,682 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-14 09:13:04,682 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:04,682 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-14 09:13:04,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 09:13:04,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 09:13:04,682 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-14 09:13:04,683 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-14 09:13:04,683 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,41875,1689325950034' in zk 2023-07-14 09:13:04,683 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:04,683 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 09:13:04,685 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-14 09:13:04,685 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:13:04,685 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-14 09:13:04,687 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 09:13:04,687 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 09:13:04,687 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 09:13:04,687 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 09:13:04,687 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689325983491.dc2cb43baee6eae5f97a5e885d7634bf. 2023-07-14 09:13:04,687 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689325983491.695fe4a0666aa123cdc31ccf977586f0. 2023-07-14 09:13:04,688 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689325983491.dc2cb43baee6eae5f97a5e885d7634bf. started... 2023-07-14 09:13:04,688 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689325983491.695fe4a0666aa123cdc31ccf977586f0. started... 2023-07-14 09:13:04,688 INFO [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] regionserver.HRegion(2745): Flushing dc2cb43baee6eae5f97a5e885d7634bf 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-14 09:13:04,688 INFO [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 695fe4a0666aa123cdc31ccf977586f0 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-14 09:13:04,717 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:13:04,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 09:13:04,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:13:04,719 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 09:13:04,754 INFO [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230714c35499697f974fadb52d871b927268b0 to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230714c35499697f974fadb52d871b927268b0 2023-07-14 09:13:04,758 INFO [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307147728baafaa0548fba7685d76235dbe90 to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307147728baafaa0548fba7685d76235dbe90 2023-07-14 09:13:04,790 INFO [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemState/dc2cb43baee6eae5f97a5e885d7634bf/.tmp/cf/438c75ce45464ec4830c74b23240fe8d 2023-07-14 09:13:04,802 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemState/dc2cb43baee6eae5f97a5e885d7634bf/.tmp/cf/438c75ce45464ec4830c74b23240fe8d as hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemState/dc2cb43baee6eae5f97a5e885d7634bf/cf/438c75ce45464ec4830c74b23240fe8d 2023-07-14 09:13:04,802 INFO [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemState/695fe4a0666aa123cdc31ccf977586f0/.tmp/cf/f6344a6ff41f47cfb401d7253127a978 2023-07-14 09:13:04,808 INFO [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemState/dc2cb43baee6eae5f97a5e885d7634bf/cf/438c75ce45464ec4830c74b23240fe8d, entries=5, sequenceid=6, filesize=5.7 K 2023-07-14 09:13:04,809 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemState/695fe4a0666aa123cdc31ccf977586f0/.tmp/cf/f6344a6ff41f47cfb401d7253127a978 as hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemState/695fe4a0666aa123cdc31ccf977586f0/cf/f6344a6ff41f47cfb401d7253127a978 2023-07-14 09:13:04,809 INFO [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for dc2cb43baee6eae5f97a5e885d7634bf in 121ms, sequenceid=6, compaction requested=false 2023-07-14 09:13:04,810 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-14 09:13:04,810 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dc2cb43baee6eae5f97a5e885d7634bf: 2023-07-14 09:13:04,810 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689325983491.dc2cb43baee6eae5f97a5e885d7634bf.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-14 09:13:04,810 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 09:13:04,811 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemState/dc2cb43baee6eae5f97a5e885d7634bf/cf/438c75ce45464ec4830c74b23240fe8d] hfiles 2023-07-14 09:13:04,812 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemState/dc2cb43baee6eae5f97a5e885d7634bf/cf/438c75ce45464ec4830c74b23240fe8d for snapshot=snaptb0-testExportFileSystemState 2023-07-14 09:13:04,822 INFO [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemState/695fe4a0666aa123cdc31ccf977586f0/cf/f6344a6ff41f47cfb401d7253127a978, entries=45, sequenceid=6, filesize=12.5 K 2023-07-14 09:13:04,823 INFO [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 695fe4a0666aa123cdc31ccf977586f0 in 135ms, sequenceid=6, compaction requested=false 2023-07-14 09:13:04,827 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 695fe4a0666aa123cdc31ccf977586f0: 2023-07-14 09:13:04,827 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689325983491.695fe4a0666aa123cdc31ccf977586f0.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-14 09:13:04,827 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 09:13:04,827 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemState/695fe4a0666aa123cdc31ccf977586f0/cf/f6344a6ff41f47cfb401d7253127a978] hfiles 2023-07-14 09:13:04,827 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemState/695fe4a0666aa123cdc31ccf977586f0/cf/f6344a6ff41f47cfb401d7253127a978 for snapshot=snaptb0-testExportFileSystemState 2023-07-14 09:13:04,859 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689325983491.dc2cb43baee6eae5f97a5e885d7634bf. completed. 2023-07-14 09:13:04,859 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689325983491.dc2cb43baee6eae5f97a5e885d7634bf. 2023-07-14 09:13:04,859 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 09:13:04,859 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 09:13:04,859 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:04,859 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-14 09:13:04,859 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,45899,1689325949913' in zk 2023-07-14 09:13:04,865 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:04,865 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-14 09:13:04,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:04,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:13:04,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:13:04,866 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:13:04,866 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-14 09:13:04,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:13:04,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:13:04,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 09:13:04,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:13:04,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:04,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:04,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:13:04,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 09:13:04,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:13:04,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:04,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,45899,1689325949913': 2023-07-14 09:13:04,883 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45899,1689325949913' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-14 09:13:04,886 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689325983491.695fe4a0666aa123cdc31ccf977586f0. completed. 2023-07-14 09:13:04,887 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689325983491.695fe4a0666aa123cdc31ccf977586f0. 2023-07-14 09:13:04,887 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 09:13:04,887 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 09:13:04,887 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:04,887 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-14 09:13:04,887 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,37313,1689325949765' in zk 2023-07-14 09:13:04,889 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-14 09:13:04,889 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:04,889 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:13:04,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:04,889 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-14 09:13:04,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:13:04,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:13:04,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:13:04,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:13:04,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 09:13:04,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:13:04,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:04,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:04,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:13:04,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 09:13:04,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:13:04,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:04,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:04,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,37313,1689325949765': 2023-07-14 09:13:04,911 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,37313,1689325949765' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-14 09:13:04,911 INFO [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-14 09:13:04,911 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 09:13:04,911 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 09:13:04,911 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-14 09:13:04,911 INFO [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 09:13:04,917 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 09:13:04,917 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:13:04,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 09:13:04,917 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 09:13:04,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 09:13:04,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 09:13:04,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:13:04,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:13:04,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:13:04,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:13:04,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:13:04,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 09:13:04,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 09:13:04,918 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:13:04,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:13:04,919 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:04,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 09:13:04,919 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 09:13:04,919 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 09:13:04,919 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:13:04,920 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:04,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 09:13:04,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 09:13:04,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 09:13:04,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 09:13:04,919 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:13:04,919 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:13:04,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:13:04,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 09:13:04,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:13:04,921 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 09:13:04,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:13:04,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:13:04,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:13:04,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:13:04,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:04,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 09:13:04,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:04,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 09:13:04,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:13:04,925 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:13:04,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 09:13:04,926 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:04,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:13:04,930 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:04,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:04,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:04,939 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:13:04,939 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:04,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:13:04,939 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:13:04,939 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:13:04,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:13:04,939 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:13:04,939 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 09:13:04,939 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:04,939 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:13:04,939 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 09:13:04,939 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:04,939 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 09:13:04,939 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:04,939 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:13:04,939 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:13:04,939 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:13:04,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:13:04,939 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-14 09:13:04,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:13:04,941 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-14 09:13:04,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:13:04,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:13:04,942 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-14 09:13:04,939 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:13:04,942 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-14 09:13:04,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:13:04,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:13:04,939 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 09:13:04,942 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 09:13:04,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:13:04,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:13:04,943 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307147728baafaa0548fba7685d76235dbe90, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230714c35499697f974fadb52d871b927268b0] mob files 2023-07-14 09:13:04,943 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307147728baafaa0548fba7685d76235dbe90 2023-07-14 09:13:04,943 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230714c35499697f974fadb52d871b927268b0 2023-07-14 09:13:04,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:13:04,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:13:04,980 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-14 09:13:04,981 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,004 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,026 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-14 09:13:05,026 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,026 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,027 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689325984616Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689325984980 (+364 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1689325984980Loading Region manifests for snaptb0-testExportFileSystemState at 1689325984981 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemState at 1689325984984 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689325984996 (+12 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689325985026 (+30 ms) 2023-07-14 09:13:05,029 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-14 09:13:05,031 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 412 msec 2023-07-14 09:13:05,221 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:13:05,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 09:13:05,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 09:13:05,224 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/export-test/export-1689325985224 2023-07-14 09:13:05,224 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43771, tgtDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/export-test/export-1689325985224, rawTgtDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/export-test/export-1689325985224, srcFsUri=hdfs://localhost:43771, srcDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8 2023-07-14 09:13:05,257 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43771, inputRoot=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8 2023-07-14 09:13:05,257 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1739822438_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/export-test/export-1689325985224, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/export-test/export-1689325985224/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,257 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43771, inputRoot=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8, snapshotDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-14 09:13:05,281 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/export-test/export-1689325985224/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,337 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:05,338 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:05,338 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:05,338 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:05,339 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:05,339 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:05,339 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:05,428 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/hadoop-7596474959948946627.jar 2023-07-14 09:13:05,428 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:05,429 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:05,429 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:05,430 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:05,430 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:05,430 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:05,431 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 09:13:05,432 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 09:13:05,432 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 09:13:05,433 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 09:13:05,433 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 09:13:05,434 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 09:13:05,434 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 09:13:05,435 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 09:13:05,435 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 09:13:05,436 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 09:13:05,437 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:13:05,437 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:13:05,438 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 09:13:05,438 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:13:05,439 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:13:05,439 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 09:13:05,440 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 09:13:06,772 WARN [Listener at jenkins-hbase9.apache.org/45395] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 09:13:06,775 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-14 09:13:06,778 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-14 09:13:07,503 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 09:13:07,503 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 09:13:07,510 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960675_0001_000001 (auth:SIMPLE) 2023-07-14 09:13:08,198 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960675_0002_000001 (auth:SIMPLE) 2023-07-14 09:13:08,759 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 09:13:14,465 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960675_0002_000001 (auth:SIMPLE) 2023-07-14 09:13:16,755 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960675_0002_000001 (auth:SIMPLE) 2023-07-14 09:13:20,818 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960675_0002_000001 (auth:SIMPLE) 2023-07-14 09:13:22,131 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 09:13:22,137 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 09:13:22,158 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-14 09:13:22,158 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 09:13:22,159 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 09:13:22,160 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2112291524_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-14 09:13:22,160 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(367): hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-14 09:13:22,160 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(367): hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-14 09:13:22,161 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2112291524_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/export-test/export-1689325985224/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/export-test/export-1689325985224/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-14 09:13:22,161 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(367): hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/export-test/export-1689325985224/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-14 09:13:22,161 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(367): hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/export-test/export-1689325985224/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-14 09:13:22,176 INFO [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-14 09:13:22,176 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemState 2023-07-14 09:13:22,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-14 09:13:22,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-14 09:13:22,182 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689326002182"}]},"ts":"1689326002182"} 2023-07-14 09:13:22,184 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-14 09:13:22,186 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-14 09:13:22,188 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=dc2cb43baee6eae5f97a5e885d7634bf, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=695fe4a0666aa123cdc31ccf977586f0, UNASSIGN}] 2023-07-14 09:13:22,190 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=695fe4a0666aa123cdc31ccf977586f0, UNASSIGN 2023-07-14 09:13:22,190 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=dc2cb43baee6eae5f97a5e885d7634bf, UNASSIGN 2023-07-14 09:13:22,191 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=695fe4a0666aa123cdc31ccf977586f0, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:22,191 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689325983491.695fe4a0666aa123cdc31ccf977586f0.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689326002191"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689326002191"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689326002191"}]},"ts":"1689326002191"} 2023-07-14 09:13:22,191 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=dc2cb43baee6eae5f97a5e885d7634bf, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:22,192 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689325983491.dc2cb43baee6eae5f97a5e885d7634bf.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689326002191"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689326002191"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689326002191"}]},"ts":"1689326002191"} 2023-07-14 09:13:22,195 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure 695fe4a0666aa123cdc31ccf977586f0, server=jenkins-hbase9.apache.org,37313,1689325949765}] 2023-07-14 09:13:22,196 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure dc2cb43baee6eae5f97a5e885d7634bf, server=jenkins-hbase9.apache.org,45899,1689325949913}] 2023-07-14 09:13:22,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-14 09:13:22,348 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close dc2cb43baee6eae5f97a5e885d7634bf 2023-07-14 09:13:22,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing dc2cb43baee6eae5f97a5e885d7634bf, disabling compactions & flushes 2023-07-14 09:13:22,349 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 695fe4a0666aa123cdc31ccf977586f0 2023-07-14 09:13:22,349 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689325983491.dc2cb43baee6eae5f97a5e885d7634bf. 2023-07-14 09:13:22,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689325983491.dc2cb43baee6eae5f97a5e885d7634bf. 2023-07-14 09:13:22,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 695fe4a0666aa123cdc31ccf977586f0, disabling compactions & flushes 2023-07-14 09:13:22,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689325983491.dc2cb43baee6eae5f97a5e885d7634bf. after waiting 0 ms 2023-07-14 09:13:22,349 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689325983491.695fe4a0666aa123cdc31ccf977586f0. 2023-07-14 09:13:22,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689325983491.dc2cb43baee6eae5f97a5e885d7634bf. 2023-07-14 09:13:22,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689325983491.695fe4a0666aa123cdc31ccf977586f0. 2023-07-14 09:13:22,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689325983491.695fe4a0666aa123cdc31ccf977586f0. after waiting 0 ms 2023-07-14 09:13:22,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689325983491.695fe4a0666aa123cdc31ccf977586f0. 2023-07-14 09:13:22,372 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemState/695fe4a0666aa123cdc31ccf977586f0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 09:13:22,373 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 09:13:22,374 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689325983491.695fe4a0666aa123cdc31ccf977586f0. 2023-07-14 09:13:22,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemState/dc2cb43baee6eae5f97a5e885d7634bf/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 09:13:22,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 695fe4a0666aa123cdc31ccf977586f0: 2023-07-14 09:13:22,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 09:13:22,376 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689325983491.dc2cb43baee6eae5f97a5e885d7634bf. 2023-07-14 09:13:22,376 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for dc2cb43baee6eae5f97a5e885d7634bf: 2023-07-14 09:13:22,377 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 695fe4a0666aa123cdc31ccf977586f0 2023-07-14 09:13:22,378 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=695fe4a0666aa123cdc31ccf977586f0, regionState=CLOSED 2023-07-14 09:13:22,378 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689325983491.695fe4a0666aa123cdc31ccf977586f0.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689326002378"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689326002378"}]},"ts":"1689326002378"} 2023-07-14 09:13:22,378 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed dc2cb43baee6eae5f97a5e885d7634bf 2023-07-14 09:13:22,380 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=dc2cb43baee6eae5f97a5e885d7634bf, regionState=CLOSED 2023-07-14 09:13:22,380 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689325983491.dc2cb43baee6eae5f97a5e885d7634bf.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689326002380"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689326002380"}]},"ts":"1689326002380"} 2023-07-14 09:13:22,384 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=38 2023-07-14 09:13:22,384 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure 695fe4a0666aa123cdc31ccf977586f0, server=jenkins-hbase9.apache.org,37313,1689325949765 in 185 msec 2023-07-14 09:13:22,385 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=37 2023-07-14 09:13:22,385 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure dc2cb43baee6eae5f97a5e885d7634bf, server=jenkins-hbase9.apache.org,45899,1689325949913 in 186 msec 2023-07-14 09:13:22,387 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=695fe4a0666aa123cdc31ccf977586f0, UNASSIGN in 197 msec 2023-07-14 09:13:22,388 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-14 09:13:22,389 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=dc2cb43baee6eae5f97a5e885d7634bf, UNASSIGN in 198 msec 2023-07-14 09:13:22,389 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689326002389"}]},"ts":"1689326002389"} 2023-07-14 09:13:22,392 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-14 09:13:22,394 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-14 09:13:22,397 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 219 msec 2023-07-14 09:13:22,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-14 09:13:22,485 INFO [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-14 09:13:22,486 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemState 2023-07-14 09:13:22,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-14 09:13:22,495 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-14 09:13:22,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-14 09:13:22,497 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-14 09:13:22,498 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41875] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-14 09:13:22,502 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 09:13:22,502 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 09:13:22,502 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 09:13:22,502 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 09:13:22,502 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-14 09:13:22,503 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-14 09:13:22,503 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-14 09:13:22,503 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-14 09:13:22,504 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 09:13:22,504 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 09:13:22,504 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 09:13:22,504 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:13:22,504 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:13:22,504 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:13:22,505 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 09:13:22,505 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:13:22,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-14 09:13:22,513 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemState/dc2cb43baee6eae5f97a5e885d7634bf 2023-07-14 09:13:22,513 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemState/695fe4a0666aa123cdc31ccf977586f0 2023-07-14 09:13:22,517 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemState/dc2cb43baee6eae5f97a5e885d7634bf/cf, FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemState/dc2cb43baee6eae5f97a5e885d7634bf/recovered.edits] 2023-07-14 09:13:22,520 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemState/695fe4a0666aa123cdc31ccf977586f0/cf, FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemState/695fe4a0666aa123cdc31ccf977586f0/recovered.edits] 2023-07-14 09:13:22,524 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemState/dc2cb43baee6eae5f97a5e885d7634bf/cf/438c75ce45464ec4830c74b23240fe8d to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/archive/data/default/testtb-testExportFileSystemState/dc2cb43baee6eae5f97a5e885d7634bf/cf/438c75ce45464ec4830c74b23240fe8d 2023-07-14 09:13:22,528 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemState/695fe4a0666aa123cdc31ccf977586f0/cf/f6344a6ff41f47cfb401d7253127a978 to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/archive/data/default/testtb-testExportFileSystemState/695fe4a0666aa123cdc31ccf977586f0/cf/f6344a6ff41f47cfb401d7253127a978 2023-07-14 09:13:22,530 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemState/dc2cb43baee6eae5f97a5e885d7634bf/recovered.edits/9.seqid to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/archive/data/default/testtb-testExportFileSystemState/dc2cb43baee6eae5f97a5e885d7634bf/recovered.edits/9.seqid 2023-07-14 09:13:22,531 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemState/dc2cb43baee6eae5f97a5e885d7634bf 2023-07-14 09:13:22,534 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemState/695fe4a0666aa123cdc31ccf977586f0/recovered.edits/9.seqid to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/archive/data/default/testtb-testExportFileSystemState/695fe4a0666aa123cdc31ccf977586f0/recovered.edits/9.seqid 2023-07-14 09:13:22,534 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemState/695fe4a0666aa123cdc31ccf977586f0 2023-07-14 09:13:22,535 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-14 09:13:22,535 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-14 09:13:22,536 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-14 09:13:22,540 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307147728baafaa0548fba7685d76235dbe90 to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307147728baafaa0548fba7685d76235dbe90 2023-07-14 09:13:22,542 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230714c35499697f974fadb52d871b927268b0 to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230714c35499697f974fadb52d871b927268b0 2023-07-14 09:13:22,543 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-14 09:13:22,551 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-14 09:13:22,554 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-14 09:13:22,556 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-14 09:13:22,558 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-14 09:13:22,558 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-14 09:13:22,558 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689325983491.dc2cb43baee6eae5f97a5e885d7634bf.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689326002558"}]},"ts":"9223372036854775807"} 2023-07-14 09:13:22,558 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689325983491.695fe4a0666aa123cdc31ccf977586f0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689326002558"}]},"ts":"9223372036854775807"} 2023-07-14 09:13:22,560 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 09:13:22,560 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => dc2cb43baee6eae5f97a5e885d7634bf, NAME => 'testtb-testExportFileSystemState,,1689325983491.dc2cb43baee6eae5f97a5e885d7634bf.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 695fe4a0666aa123cdc31ccf977586f0, NAME => 'testtb-testExportFileSystemState,1,1689325983491.695fe4a0666aa123cdc31ccf977586f0.', STARTKEY => '1', ENDKEY => ''}] 2023-07-14 09:13:22,560 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-14 09:13:22,560 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689326002560"}]},"ts":"9223372036854775807"} 2023-07-14 09:13:22,562 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-14 09:13:22,564 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-14 09:13:22,566 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 79 msec 2023-07-14 09:13:22,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-14 09:13:22,607 INFO [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-14 09:13:22,616 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-14 09:13:22,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:22,620 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemState" 2023-07-14 09:13:22,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-14 09:13:22,659 INFO [Listener at jenkins-hbase9.apache.org/45395] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=763 (was 750) Potentially hanging thread: IPC Client (130951516) connection to jenkins-hbase9.apache.org/172.31.2.10:41541 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2112291524_17 at /127.0.0.1:59590 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2029 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6b086784-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6b086784-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2112291524_17 at /127.0.0.1:40870 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6b086784-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6b086784-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_21016563_1 at /127.0.0.1:43538 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2112291524_17 at /127.0.0.1:34544 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=926 (was 920) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=691 (was 587) - SystemLoadAverage LEAK? -, ProcessCount=190 (was 190), AvailableMemoryMB=1298 (was 1759) 2023-07-14 09:13:22,659 WARN [Listener at jenkins-hbase9.apache.org/45395] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-14 09:13:22,683 INFO [Listener at jenkins-hbase9.apache.org/45395] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=763, OpenFileDescriptor=926, MaxFileDescriptor=60000, SystemLoadAverage=691, ProcessCount=190, AvailableMemoryMB=1297 2023-07-14 09:13:22,683 WARN [Listener at jenkins-hbase9.apache.org/45395] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-14 09:13:22,685 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-14 09:13:22,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-14 09:13:22,689 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 09:13:22,689 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-14 09:13:22,690 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 09:13:22,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-14 09:13:22,694 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testConsecutiveExports/e8a5c78957fd0c95719e2f1e7ad04d46 2023-07-14 09:13:22,694 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testConsecutiveExports/75047c016f2a8cbbea290c0f580773cd 2023-07-14 09:13:22,695 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testConsecutiveExports/e8a5c78957fd0c95719e2f1e7ad04d46 empty. 2023-07-14 09:13:22,695 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testConsecutiveExports/75047c016f2a8cbbea290c0f580773cd empty. 2023-07-14 09:13:22,695 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testConsecutiveExports/e8a5c78957fd0c95719e2f1e7ad04d46 2023-07-14 09:13:22,695 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testConsecutiveExports/75047c016f2a8cbbea290c0f580773cd 2023-07-14 09:13:22,695 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-14 09:13:22,710 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-14 09:13:22,711 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => e8a5c78957fd0c95719e2f1e7ad04d46, NAME => 'testtb-testConsecutiveExports,,1689326002685.e8a5c78957fd0c95719e2f1e7ad04d46.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp 2023-07-14 09:13:22,712 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 75047c016f2a8cbbea290c0f580773cd, NAME => 'testtb-testConsecutiveExports,1,1689326002685.75047c016f2a8cbbea290c0f580773cd.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp 2023-07-14 09:13:22,751 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689326002685.e8a5c78957fd0c95719e2f1e7ad04d46.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:13:22,751 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689326002685.75047c016f2a8cbbea290c0f580773cd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:13:22,751 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing e8a5c78957fd0c95719e2f1e7ad04d46, disabling compactions & flushes 2023-07-14 09:13:22,751 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 75047c016f2a8cbbea290c0f580773cd, disabling compactions & flushes 2023-07-14 09:13:22,751 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689326002685.e8a5c78957fd0c95719e2f1e7ad04d46. 2023-07-14 09:13:22,751 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689326002685.75047c016f2a8cbbea290c0f580773cd. 2023-07-14 09:13:22,751 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689326002685.e8a5c78957fd0c95719e2f1e7ad04d46. 2023-07-14 09:13:22,751 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689326002685.75047c016f2a8cbbea290c0f580773cd. 2023-07-14 09:13:22,751 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689326002685.e8a5c78957fd0c95719e2f1e7ad04d46. after waiting 0 ms 2023-07-14 09:13:22,751 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689326002685.75047c016f2a8cbbea290c0f580773cd. after waiting 0 ms 2023-07-14 09:13:22,751 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689326002685.e8a5c78957fd0c95719e2f1e7ad04d46. 2023-07-14 09:13:22,751 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689326002685.75047c016f2a8cbbea290c0f580773cd. 2023-07-14 09:13:22,751 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689326002685.e8a5c78957fd0c95719e2f1e7ad04d46. 2023-07-14 09:13:22,751 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689326002685.75047c016f2a8cbbea290c0f580773cd. 2023-07-14 09:13:22,751 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for e8a5c78957fd0c95719e2f1e7ad04d46: 2023-07-14 09:13:22,751 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 75047c016f2a8cbbea290c0f580773cd: 2023-07-14 09:13:22,754 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 09:13:22,755 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689326002685.e8a5c78957fd0c95719e2f1e7ad04d46.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689326002755"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689326002755"}]},"ts":"1689326002755"} 2023-07-14 09:13:22,755 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689326002685.75047c016f2a8cbbea290c0f580773cd.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689326002755"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689326002755"}]},"ts":"1689326002755"} 2023-07-14 09:13:22,758 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 09:13:22,759 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 09:13:22,759 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689326002759"}]},"ts":"1689326002759"} 2023-07-14 09:13:22,761 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-14 09:13:22,764 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 09:13:22,765 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 09:13:22,765 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 09:13:22,765 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 09:13:22,765 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 09:13:22,765 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e8a5c78957fd0c95719e2f1e7ad04d46, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=75047c016f2a8cbbea290c0f580773cd, ASSIGN}] 2023-07-14 09:13:22,768 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e8a5c78957fd0c95719e2f1e7ad04d46, ASSIGN 2023-07-14 09:13:22,768 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=75047c016f2a8cbbea290c0f580773cd, ASSIGN 2023-07-14 09:13:22,769 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=75047c016f2a8cbbea290c0f580773cd, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,37313,1689325949765; forceNewPlan=false, retain=false 2023-07-14 09:13:22,769 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e8a5c78957fd0c95719e2f1e7ad04d46, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45899,1689325949913; forceNewPlan=false, retain=false 2023-07-14 09:13:22,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-14 09:13:22,919 INFO [jenkins-hbase9:41733] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 09:13:22,923 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=e8a5c78957fd0c95719e2f1e7ad04d46, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:22,923 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=75047c016f2a8cbbea290c0f580773cd, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:22,923 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689326002685.e8a5c78957fd0c95719e2f1e7ad04d46.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689326002923"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689326002923"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689326002923"}]},"ts":"1689326002923"} 2023-07-14 09:13:22,923 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689326002685.75047c016f2a8cbbea290c0f580773cd.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689326002923"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689326002923"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689326002923"}]},"ts":"1689326002923"} 2023-07-14 09:13:22,926 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure e8a5c78957fd0c95719e2f1e7ad04d46, server=jenkins-hbase9.apache.org,45899,1689325949913}] 2023-07-14 09:13:22,927 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 75047c016f2a8cbbea290c0f580773cd, server=jenkins-hbase9.apache.org,37313,1689325949765}] 2023-07-14 09:13:22,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-14 09:13:23,081 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689326002685.e8a5c78957fd0c95719e2f1e7ad04d46. 2023-07-14 09:13:23,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e8a5c78957fd0c95719e2f1e7ad04d46, NAME => 'testtb-testConsecutiveExports,,1689326002685.e8a5c78957fd0c95719e2f1e7ad04d46.', STARTKEY => '', ENDKEY => '1'} 2023-07-14 09:13:23,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689326002685.e8a5c78957fd0c95719e2f1e7ad04d46. service=AccessControlService 2023-07-14 09:13:23,082 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689326002685.75047c016f2a8cbbea290c0f580773cd. 2023-07-14 09:13:23,082 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 09:13:23,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 75047c016f2a8cbbea290c0f580773cd, NAME => 'testtb-testConsecutiveExports,1,1689326002685.75047c016f2a8cbbea290c0f580773cd.', STARTKEY => '1', ENDKEY => ''} 2023-07-14 09:13:23,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports e8a5c78957fd0c95719e2f1e7ad04d46 2023-07-14 09:13:23,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689326002685.e8a5c78957fd0c95719e2f1e7ad04d46.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:13:23,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689326002685.75047c016f2a8cbbea290c0f580773cd. service=AccessControlService 2023-07-14 09:13:23,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for e8a5c78957fd0c95719e2f1e7ad04d46 2023-07-14 09:13:23,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for e8a5c78957fd0c95719e2f1e7ad04d46 2023-07-14 09:13:23,083 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 09:13:23,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 75047c016f2a8cbbea290c0f580773cd 2023-07-14 09:13:23,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689326002685.75047c016f2a8cbbea290c0f580773cd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:13:23,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 75047c016f2a8cbbea290c0f580773cd 2023-07-14 09:13:23,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 75047c016f2a8cbbea290c0f580773cd 2023-07-14 09:13:23,085 INFO [StoreOpener-e8a5c78957fd0c95719e2f1e7ad04d46-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e8a5c78957fd0c95719e2f1e7ad04d46 2023-07-14 09:13:23,085 INFO [StoreOpener-75047c016f2a8cbbea290c0f580773cd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 75047c016f2a8cbbea290c0f580773cd 2023-07-14 09:13:23,086 DEBUG [StoreOpener-e8a5c78957fd0c95719e2f1e7ad04d46-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testConsecutiveExports/e8a5c78957fd0c95719e2f1e7ad04d46/cf 2023-07-14 09:13:23,086 DEBUG [StoreOpener-e8a5c78957fd0c95719e2f1e7ad04d46-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testConsecutiveExports/e8a5c78957fd0c95719e2f1e7ad04d46/cf 2023-07-14 09:13:23,086 DEBUG [StoreOpener-75047c016f2a8cbbea290c0f580773cd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testConsecutiveExports/75047c016f2a8cbbea290c0f580773cd/cf 2023-07-14 09:13:23,086 DEBUG [StoreOpener-75047c016f2a8cbbea290c0f580773cd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testConsecutiveExports/75047c016f2a8cbbea290c0f580773cd/cf 2023-07-14 09:13:23,087 INFO [StoreOpener-e8a5c78957fd0c95719e2f1e7ad04d46-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e8a5c78957fd0c95719e2f1e7ad04d46 columnFamilyName cf 2023-07-14 09:13:23,087 INFO [StoreOpener-75047c016f2a8cbbea290c0f580773cd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 75047c016f2a8cbbea290c0f580773cd columnFamilyName cf 2023-07-14 09:13:23,088 INFO [StoreOpener-75047c016f2a8cbbea290c0f580773cd-1] regionserver.HStore(310): Store=75047c016f2a8cbbea290c0f580773cd/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 09:13:23,088 INFO [StoreOpener-e8a5c78957fd0c95719e2f1e7ad04d46-1] regionserver.HStore(310): Store=e8a5c78957fd0c95719e2f1e7ad04d46/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 09:13:23,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testConsecutiveExports/75047c016f2a8cbbea290c0f580773cd 2023-07-14 09:13:23,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testConsecutiveExports/e8a5c78957fd0c95719e2f1e7ad04d46 2023-07-14 09:13:23,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testConsecutiveExports/75047c016f2a8cbbea290c0f580773cd 2023-07-14 09:13:23,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testConsecutiveExports/e8a5c78957fd0c95719e2f1e7ad04d46 2023-07-14 09:13:23,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for e8a5c78957fd0c95719e2f1e7ad04d46 2023-07-14 09:13:23,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 75047c016f2a8cbbea290c0f580773cd 2023-07-14 09:13:23,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testConsecutiveExports/e8a5c78957fd0c95719e2f1e7ad04d46/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 09:13:23,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testConsecutiveExports/75047c016f2a8cbbea290c0f580773cd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 09:13:23,096 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened e8a5c78957fd0c95719e2f1e7ad04d46; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59229446, jitterRate=-0.11741247773170471}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 09:13:23,096 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 75047c016f2a8cbbea290c0f580773cd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70183144, jitterRate=0.04581034183502197}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 09:13:23,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for e8a5c78957fd0c95719e2f1e7ad04d46: 2023-07-14 09:13:23,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 75047c016f2a8cbbea290c0f580773cd: 2023-07-14 09:13:23,097 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689326002685.75047c016f2a8cbbea290c0f580773cd., pid=46, masterSystemTime=1689326003079 2023-07-14 09:13:23,098 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689326002685.e8a5c78957fd0c95719e2f1e7ad04d46., pid=45, masterSystemTime=1689326003078 2023-07-14 09:13:23,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689326002685.75047c016f2a8cbbea290c0f580773cd. 2023-07-14 09:13:23,102 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689326002685.75047c016f2a8cbbea290c0f580773cd. 2023-07-14 09:13:23,103 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=75047c016f2a8cbbea290c0f580773cd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:23,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689326002685.e8a5c78957fd0c95719e2f1e7ad04d46. 2023-07-14 09:13:23,103 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689326002685.e8a5c78957fd0c95719e2f1e7ad04d46. 2023-07-14 09:13:23,103 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689326002685.75047c016f2a8cbbea290c0f580773cd.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689326003103"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689326003103"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689326003103"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689326003103"}]},"ts":"1689326003103"} 2023-07-14 09:13:23,104 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=e8a5c78957fd0c95719e2f1e7ad04d46, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:23,104 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689326002685.e8a5c78957fd0c95719e2f1e7ad04d46.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689326003104"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689326003104"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689326003104"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689326003104"}]},"ts":"1689326003104"} 2023-07-14 09:13:23,109 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=44 2023-07-14 09:13:23,109 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 75047c016f2a8cbbea290c0f580773cd, server=jenkins-hbase9.apache.org,37313,1689325949765 in 178 msec 2023-07-14 09:13:23,110 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-07-14 09:13:23,110 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure e8a5c78957fd0c95719e2f1e7ad04d46, server=jenkins-hbase9.apache.org,45899,1689325949913 in 180 msec 2023-07-14 09:13:23,112 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=75047c016f2a8cbbea290c0f580773cd, ASSIGN in 344 msec 2023-07-14 09:13:23,113 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-14 09:13:23,113 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e8a5c78957fd0c95719e2f1e7ad04d46, ASSIGN in 345 msec 2023-07-14 09:13:23,115 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 09:13:23,116 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689326003115"}]},"ts":"1689326003115"} 2023-07-14 09:13:23,117 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-14 09:13:23,183 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 09:13:23,184 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-14 09:13:23,186 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41875] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-14 09:13:23,228 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:13:23,228 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:13:23,228 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:13:23,229 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:13:23,260 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-14 09:13:23,260 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-14 09:13:23,260 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-14 09:13:23,260 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-14 09:13:23,262 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 575 msec 2023-07-14 09:13:23,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-14 09:13:23,294 INFO [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-14 09:13:23,297 DEBUG [Listener at jenkins-hbase9.apache.org/45395] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-14 09:13:23,297 DEBUG [Listener at jenkins-hbase9.apache.org/45395] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689326002685.e8a5c78957fd0c95719e2f1e7ad04d46. 2023-07-14 09:13:23,299 INFO [Listener at jenkins-hbase9.apache.org/45395] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 09:13:23,317 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-14 09:13:23,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689326003318 (current time:1689326003318). 2023-07-14 09:13:23,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 09:13:23,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] zookeeper.ReadOnlyZKClient(139): Connect 0x70d3858b to 127.0.0.1:59920 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:13:23,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a9520dc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:13:23,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:13:23,351 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:59172, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:13:23,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x70d3858b to 127.0.0.1:59920 2023-07-14 09:13:23,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:13:23,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] zookeeper.ReadOnlyZKClient(139): Connect 0x7f943663 to 127.0.0.1:59920 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:13:23,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@13070bc7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:13:23,363 DEBUG [hconnection-0x74abb-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:13:23,365 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:59174, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:13:23,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:13:23,372 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:56366, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:13:23,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7f943663 to 127.0.0.1:59920 2023-07-14 09:13:23,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:13:23,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-14 09:13:23,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 09:13:23,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-14 09:13:23,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-14 09:13:23,379 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-14 09:13:23,380 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689326603380 2023-07-14 09:13:23,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-14 09:13:23,380 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-14 09:13:23,381 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 09:13:23,382 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 09:13:23,385 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-14 09:13:23,385 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-14 09:13:23,386 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 8 msec 2023-07-14 09:13:23,387 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-14 09:13:23,388 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689326603388 2023-07-14 09:13:23,406 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,407 INFO [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-14 09:13:23,407 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:13:23,408 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-14 09:13:23,408 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-14 09:13:23,408 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,409 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,416 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:13:23,416 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:13:23,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:13:23,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:13:23,416 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:23,416 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:13:23,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:13:23,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:13:23,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:13:23,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:13:23,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,417 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:23,417 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:23,417 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,418 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,418 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:23,418 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 09:13:23,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-14 09:13:23,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,418 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-14 09:13:23,418 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,419 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-14 09:13:23,419 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:13:23,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-14 09:13:23,420 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,420 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-14 09:13:23,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,420 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-14 09:13:23,420 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,37313,1689325949765' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-14 09:13:23,420 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-14 09:13:23,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-14 09:13:23,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,421 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,421 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-14 09:13:23,421 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-14 09:13:23,421 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:13:23,422 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-14 09:13:23,422 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,422 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-14 09:13:23,423 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-14 09:13:23,423 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:13:23,423 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45899,1689325949913' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-14 09:13:23,423 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,423 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:23,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:23,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:13:23,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:13:23,428 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-14 09:13:23,428 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,428 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:13:23,428 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-14 09:13:23,429 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41875,1689325950034' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-14 09:13:23,429 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:13:23,430 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:23,431 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,431 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,431 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:13:23,431 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,431 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:13:23,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:13:23,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:13:23,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:23,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:23,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:13:23,434 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,37313,1689325949765' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-14 09:13:23,434 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a9cb35a[Count = 1] remaining members to acquire global barrier 2023-07-14 09:13:23,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:23,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:13:23,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:13:23,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:13:23,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:13:23,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:13:23,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:23,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:23,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:13:23,439 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45899,1689325949913' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-14 09:13:23,439 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a9cb35a[Count = 0] remaining members to acquire global barrier 2023-07-14 09:13:23,439 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-14 09:13:23,439 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,442 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,442 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,442 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,442 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-14 09:13:23,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,442 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-14 09:13:23,442 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-14 09:13:23,443 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,41875,1689325950034' in zk 2023-07-14 09:13:23,442 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-14 09:13:23,443 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:23,445 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 09:13:23,445 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 09:13:23,445 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689326002685.75047c016f2a8cbbea290c0f580773cd. 2023-07-14 09:13:23,446 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689326002685.75047c016f2a8cbbea290c0f580773cd. started... 2023-07-14 09:13:23,448 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-14 09:13:23,448 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:13:23,449 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-14 09:13:23,449 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:23,449 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 09:13:23,450 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 09:13:23,452 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 09:13:23,452 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689326002685.e8a5c78957fd0c95719e2f1e7ad04d46. 2023-07-14 09:13:23,452 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689326002685.e8a5c78957fd0c95719e2f1e7ad04d46. started... 2023-07-14 09:13:23,452 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 75047c016f2a8cbbea290c0f580773cd: 2023-07-14 09:13:23,452 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e8a5c78957fd0c95719e2f1e7ad04d46: 2023-07-14 09:13:23,453 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689326002685.e8a5c78957fd0c95719e2f1e7ad04d46.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,453 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689326002685.75047c016f2a8cbbea290c0f580773cd.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,453 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 09:13:23,453 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 09:13:23,453 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 09:13:23,453 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 09:13:23,482 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:13:23,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-14 09:13:23,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:13:23,483 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 09:13:23,497 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689326002685.75047c016f2a8cbbea290c0f580773cd. completed. 2023-07-14 09:13:23,497 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689326002685.75047c016f2a8cbbea290c0f580773cd. 2023-07-14 09:13:23,497 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 09:13:23,497 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 09:13:23,497 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:23,498 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-14 09:13:23,498 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,37313,1689325949765' in zk 2023-07-14 09:13:23,500 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:23,500 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-14 09:13:23,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:23,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:13:23,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:13:23,500 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:13:23,500 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-14 09:13:23,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:13:23,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:13:23,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:13:23,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:23,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:23,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:13:23,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:13:23,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:23,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,37313,1689325949765': 2023-07-14 09:13:23,512 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,37313,1689325949765' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-14 09:13:23,684 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:13:23,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-14 09:13:23,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:13:23,686 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 09:13:23,887 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689326002685.e8a5c78957fd0c95719e2f1e7ad04d46. completed. 2023-07-14 09:13:23,887 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689326002685.e8a5c78957fd0c95719e2f1e7ad04d46. 2023-07-14 09:13:23,887 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 09:13:23,887 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 09:13:23,887 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:23,887 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-14 09:13:23,887 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,45899,1689325949913' in zk 2023-07-14 09:13:23,889 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-14 09:13:23,889 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:23,889 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:13:23,889 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-14 09:13:23,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:23,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:13:23,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:13:23,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:13:23,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:13:23,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:13:23,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:23,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:23,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:13:23,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:13:23,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:23,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:23,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,45899,1689325949913': 2023-07-14 09:13:23,894 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45899,1689325949913' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-14 09:13:23,894 INFO [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-14 09:13:23,895 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 09:13:23,895 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 09:13:23,895 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,895 INFO [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 09:13:23,897 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,898 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,898 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:13:23,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:13:23,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,898 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:13:23,898 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,898 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:13:23,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,898 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:13:23,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:13:23,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:13:23,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:13:23,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:13:23,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:13:23,900 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:13:23,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:13:23,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:13:23,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,900 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:23,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:13:23,901 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:23,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:13:23,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:23,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:23,904 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:13:23,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:13:23,904 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:23,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,905 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:23,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:13:23,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:23,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:23,908 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:23,908 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,908 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:13:23,908 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:13:23,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:13:23,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:13:23,908 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:23,908 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:13:23,908 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:13:23,908 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:13:23,908 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:13:23,908 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,908 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:13:23,908 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:13:23,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:13:23,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:13:23,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:13:23,910 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:23,910 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-14 09:13:23,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:13:23,910 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,910 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:13:23,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:13:23,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:13:23,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:13:23,910 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,911 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-14 09:13:23,911 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:23,911 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:13:23,911 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,911 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:13:23,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:13:23,912 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-14 09:13:23,920 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,921 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,966 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,986 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:13:23,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-14 09:13:23,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:13:23,988 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-14 09:13:23,991 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-14 09:13:23,991 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,992 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:23,992 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689326003380Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689326003920 (+540 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689326003920Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689326003920Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689326003925 (+5 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689326003960 (+35 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689326003991 (+31 ms) 2023-07-14 09:13:23,995 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-14 09:13:23,998 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 614 msec 2023-07-14 09:13:24,488 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:13:24,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-14 09:13:24,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 09:13:24,495 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45899] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689326002685.e8a5c78957fd0c95719e2f1e7ad04d46. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 09:13:24,497 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37313] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689326002685.75047c016f2a8cbbea290c0f580773cd. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 09:13:24,503 DEBUG [Listener at jenkins-hbase9.apache.org/45395] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-14 09:13:24,503 DEBUG [Listener at jenkins-hbase9.apache.org/45395] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689326002685.e8a5c78957fd0c95719e2f1e7ad04d46. 2023-07-14 09:13:24,503 INFO [Listener at jenkins-hbase9.apache.org/45395] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 09:13:24,519 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-14 09:13:24,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689326004519 (current time:1689326004519). 2023-07-14 09:13:24,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 09:13:24,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] zookeeper.ReadOnlyZKClient(139): Connect 0x085da479 to 127.0.0.1:59920 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:13:24,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3bbce983, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:13:24,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:13:24,535 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:59180, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:13:24,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x085da479 to 127.0.0.1:59920 2023-07-14 09:13:24,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:13:24,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] zookeeper.ReadOnlyZKClient(139): Connect 0x473e9caa to 127.0.0.1:59920 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:13:24,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22a58658, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:13:24,547 DEBUG [hconnection-0x7e89937e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:13:24,552 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:59182, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:13:24,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:13:24,559 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:56370, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:13:24,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x473e9caa to 127.0.0.1:59920 2023-07-14 09:13:24,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:13:24,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-14 09:13:24,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 09:13:24,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-14 09:13:24,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-14 09:13:24,566 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-14 09:13:24,567 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689326604567 2023-07-14 09:13:24,567 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-14 09:13:24,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-14 09:13:24,569 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 09:13:24,569 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 09:13:24,571 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-14 09:13:24,571 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-14 09:13:24,574 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 8 msec 2023-07-14 09:13:24,575 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-14 09:13:24,576 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689326604576 2023-07-14 09:13:24,590 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-14 09:13:24,591 INFO [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-14 09:13:24,591 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:13:24,595 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-14 09:13:24,595 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-14 09:13:24,664 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 09:13:24,664 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 09:13:24,665 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:13:24,665 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:24,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:13:24,665 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:13:24,665 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:13:24,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:13:24,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:13:24,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:13:24,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:13:24,665 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:24,665 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:24,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:13:24,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 09:13:24,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 09:13:24,670 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:13:24,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 09:13:24,670 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:24,670 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 09:13:24,670 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 09:13:24,670 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 09:13:24,670 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 09:13:24,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-14 09:13:24,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 09:13:24,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-14 09:13:24,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 09:13:24,671 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-14 09:13:24,671 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-14 09:13:24,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-14 09:13:24,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-14 09:13:24,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 09:13:24,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:13:24,671 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-14 09:13:24,671 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 09:13:24,676 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-14 09:13:24,676 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-14 09:13:24,676 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-14 09:13:24,676 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-14 09:13:24,676 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-14 09:13:24,676 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:13:24,676 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:13:24,676 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-14 09:13:24,679 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:13:24,679 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-14 09:13:24,681 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-14 09:13:24,681 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,37313,1689325949765' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-14 09:13:24,678 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-14 09:13:24,681 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-14 09:13:24,681 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45899,1689325949913' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-14 09:13:24,681 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-14 09:13:24,681 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-14 09:13:24,681 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41875,1689325950034' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-14 09:13:24,683 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 09:13:24,683 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:24,683 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 09:13:24,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:24,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:13:24,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:13:24,683 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:24,684 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 09:13:24,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:13:24,684 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 09:13:24,684 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 09:13:24,684 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:13:24,684 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:13:24,684 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 09:13:24,684 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:13:24,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:13:24,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 09:13:24,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:13:24,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:24,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:24,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:13:24,687 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45899,1689325949913' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-14 09:13:24,687 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7396d6c9[Count = 1] remaining members to acquire global barrier 2023-07-14 09:13:24,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:24,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:13:24,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:13:24,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:13:24,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:13:24,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 09:13:24,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:13:24,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:24,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:24,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:13:24,692 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,37313,1689325949765' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-14 09:13:24,693 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7396d6c9[Count = 0] remaining members to acquire global barrier 2023-07-14 09:13:24,693 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-14 09:13:24,693 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 09:13:24,695 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 09:13:24,695 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 09:13:24,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 09:13:24,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 09:13:24,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 09:13:24,696 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 09:13:24,696 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:24,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 09:13:24,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 09:13:24,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 09:13:24,696 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-14 09:13:24,696 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-14 09:13:24,696 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-14 09:13:24,696 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-14 09:13:24,696 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,41875,1689325950034' in zk 2023-07-14 09:13:24,696 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 09:13:24,697 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 09:13:24,697 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 09:13:24,697 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 09:13:24,697 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689326002685.75047c016f2a8cbbea290c0f580773cd. 2023-07-14 09:13:24,697 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689326002685.75047c016f2a8cbbea290c0f580773cd. started... 2023-07-14 09:13:24,697 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689326002685.e8a5c78957fd0c95719e2f1e7ad04d46. 2023-07-14 09:13:24,697 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689326002685.e8a5c78957fd0c95719e2f1e7ad04d46. started... 2023-07-14 09:13:24,697 INFO [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e8a5c78957fd0c95719e2f1e7ad04d46 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-14 09:13:24,698 INFO [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 75047c016f2a8cbbea290c0f580773cd 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-14 09:13:24,700 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-14 09:13:24,700 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:13:24,700 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:24,702 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 09:13:24,700 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-14 09:13:24,805 INFO [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071465bd68e9de2a4fc38af1371860c15bd1 to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071465bd68e9de2a4fc38af1371860c15bd1 2023-07-14 09:13:24,871 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:13:24,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-14 09:13:24,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:13:24,873 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 09:13:24,876 INFO [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testConsecutiveExports/75047c016f2a8cbbea290c0f580773cd/.tmp/cf/784220ba1931460d88b4f17d3e773a57 2023-07-14 09:13:24,884 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testConsecutiveExports/75047c016f2a8cbbea290c0f580773cd/.tmp/cf/784220ba1931460d88b4f17d3e773a57 as hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testConsecutiveExports/75047c016f2a8cbbea290c0f580773cd/cf/784220ba1931460d88b4f17d3e773a57 2023-07-14 09:13:24,896 INFO [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testConsecutiveExports/75047c016f2a8cbbea290c0f580773cd/cf/784220ba1931460d88b4f17d3e773a57, entries=45, sequenceid=6, filesize=12.4 K 2023-07-14 09:13:24,897 INFO [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 75047c016f2a8cbbea290c0f580773cd in 199ms, sequenceid=6, compaction requested=false 2023-07-14 09:13:24,898 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-14 09:13:24,898 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 75047c016f2a8cbbea290c0f580773cd: 2023-07-14 09:13:24,898 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689326002685.75047c016f2a8cbbea290c0f580773cd.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-14 09:13:24,899 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 09:13:24,899 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testConsecutiveExports/75047c016f2a8cbbea290c0f580773cd/cf/784220ba1931460d88b4f17d3e773a57] hfiles 2023-07-14 09:13:24,899 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testConsecutiveExports/75047c016f2a8cbbea290c0f580773cd/cf/784220ba1931460d88b4f17d3e773a57 for snapshot=snaptb0-testConsecutiveExports 2023-07-14 09:13:24,932 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689326002685.75047c016f2a8cbbea290c0f580773cd. completed. 2023-07-14 09:13:24,932 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689326002685.75047c016f2a8cbbea290c0f580773cd. 2023-07-14 09:13:24,932 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 09:13:24,932 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 09:13:24,932 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:24,932 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-14 09:13:24,932 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,37313,1689325949765' in zk 2023-07-14 09:13:24,934 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:24,934 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-14 09:13:24,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:24,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:13:24,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:13:24,934 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:13:24,935 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-14 09:13:24,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:13:24,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:13:24,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 09:13:24,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:13:24,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:24,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:24,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:13:24,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 09:13:24,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:13:24,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:24,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,37313,1689325949765': 2023-07-14 09:13:24,943 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,37313,1689325949765' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-14 09:13:25,174 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:13:25,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-14 09:13:25,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:13:25,175 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-14 09:13:25,189 INFO [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307142bf1ecfe9bd5403bb057a9055e191cd6 to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307142bf1ecfe9bd5403bb057a9055e191cd6 2023-07-14 09:13:25,199 INFO [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testConsecutiveExports/e8a5c78957fd0c95719e2f1e7ad04d46/.tmp/cf/beafb9414f734197862a770361238743 2023-07-14 09:13:25,207 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testConsecutiveExports/e8a5c78957fd0c95719e2f1e7ad04d46/.tmp/cf/beafb9414f734197862a770361238743 as hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testConsecutiveExports/e8a5c78957fd0c95719e2f1e7ad04d46/cf/beafb9414f734197862a770361238743 2023-07-14 09:13:25,217 INFO [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testConsecutiveExports/e8a5c78957fd0c95719e2f1e7ad04d46/cf/beafb9414f734197862a770361238743, entries=5, sequenceid=6, filesize=5.7 K 2023-07-14 09:13:25,218 INFO [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for e8a5c78957fd0c95719e2f1e7ad04d46 in 521ms, sequenceid=6, compaction requested=false 2023-07-14 09:13:25,220 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e8a5c78957fd0c95719e2f1e7ad04d46: 2023-07-14 09:13:25,220 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689326002685.e8a5c78957fd0c95719e2f1e7ad04d46.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-14 09:13:25,221 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 09:13:25,221 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testConsecutiveExports/e8a5c78957fd0c95719e2f1e7ad04d46/cf/beafb9414f734197862a770361238743] hfiles 2023-07-14 09:13:25,221 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testConsecutiveExports/e8a5c78957fd0c95719e2f1e7ad04d46/cf/beafb9414f734197862a770361238743 for snapshot=snaptb0-testConsecutiveExports 2023-07-14 09:13:25,234 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689326002685.e8a5c78957fd0c95719e2f1e7ad04d46. completed. 2023-07-14 09:13:25,234 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689326002685.e8a5c78957fd0c95719e2f1e7ad04d46. 2023-07-14 09:13:25,234 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 09:13:25,234 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 09:13:25,234 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:25,234 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-14 09:13:25,234 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,45899,1689325949913' in zk 2023-07-14 09:13:25,236 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:25,236 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-14 09:13:25,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:25,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:13:25,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:13:25,236 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:13:25,236 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-14 09:13:25,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:13:25,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:13:25,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 09:13:25,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:13:25,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:25,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:25,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:13:25,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 09:13:25,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:13:25,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:25,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:25,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,45899,1689325949913': 2023-07-14 09:13:25,243 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45899,1689325949913' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-14 09:13:25,243 INFO [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-14 09:13:25,243 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 09:13:25,243 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 09:13:25,243 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-14 09:13:25,243 INFO [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 09:13:25,245 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 09:13:25,245 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 09:13:25,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 09:13:25,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 09:13:25,245 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:13:25,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 09:13:25,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 09:13:25,245 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:13:25,245 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 09:13:25,246 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:13:25,245 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 09:13:25,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 09:13:25,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 09:13:25,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:13:25,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:13:25,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 09:13:25,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:13:25,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:13:25,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:13:25,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:13:25,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:13:25,246 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:13:25,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:13:25,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:13:25,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 09:13:25,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 09:13:25,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 09:13:25,247 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:25,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 09:13:25,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:13:25,247 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:25,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 09:13:25,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:13:25,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:25,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:25,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:13:25,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 09:13:25,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:13:25,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:25,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:25,255 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:13:25,256 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:25,256 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:25,263 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:13:25,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:13:25,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:13:25,264 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:13:25,264 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:13:25,264 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:25,263 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:13:25,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:13:25,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:13:25,264 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-14 09:13:25,264 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 09:13:25,264 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:25,264 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:13:25,264 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 09:13:25,264 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:13:25,264 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 09:13:25,264 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:13:25,264 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:13:25,265 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 09:13:25,265 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 09:13:25,264 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:13:25,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:13:25,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:13:25,264 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-14 09:13:25,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:13:25,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:13:25,264 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:13:25,264 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:13:25,265 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-14 09:13:25,267 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-14 09:13:25,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:13:25,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:13:25,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:13:25,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:13:25,270 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071465bd68e9de2a4fc38af1371860c15bd1, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307142bf1ecfe9bd5403bb057a9055e191cd6] mob files 2023-07-14 09:13:25,270 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071465bd68e9de2a4fc38af1371860c15bd1 2023-07-14 09:13:25,270 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307142bf1ecfe9bd5403bb057a9055e191cd6 2023-07-14 09:13:25,676 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:13:25,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-14 09:13:25,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:13:25,678 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-14 09:13:25,694 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-14 09:13:25,695 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 09:13:25,755 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-14 09:13:25,819 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-14 09:13:25,819 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 09:13:25,820 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 09:13:25,820 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689326004567Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689326005694 (+1127 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1689326005694Loading Region manifests for snaptb0-testConsecutiveExports at 1689326005694Writing data manifest for snaptb0-testConsecutiveExports at 1689326005716 (+22 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689326005745 (+29 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689326005819 (+74 ms) 2023-07-14 09:13:25,824 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-14 09:13:25,827 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 1.2550 sec 2023-07-14 09:13:26,678 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:13:26,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-14 09:13:26,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 09:13:26,680 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/local-export-1689326006679 2023-07-14 09:13:26,680 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/local-export-1689326006679, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/local-export-1689326006679, srcFsUri=hdfs://localhost:43771, srcDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8 2023-07-14 09:13:26,709 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43771, inputRoot=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8 2023-07-14 09:13:26,709 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@7addafda, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/local-export-1689326006679, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/local-export-1689326006679/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 09:13:26,709 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43771, inputRoot=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8, snapshotDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-14 09:13:26,718 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/local-export-1689326006679/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 09:13:26,735 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:26,736 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:26,736 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:26,736 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:26,737 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:26,737 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:26,737 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:26,842 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/hadoop-7219969416282926354.jar 2023-07-14 09:13:26,843 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:26,844 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:26,844 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:26,845 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:26,845 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:26,845 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:26,846 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 09:13:26,846 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 09:13:26,850 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 09:13:26,850 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 09:13:26,851 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 09:13:26,852 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 09:13:26,853 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 09:13:26,854 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 09:13:26,854 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 09:13:26,855 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 09:13:26,856 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:13:26,856 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:13:26,857 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 09:13:26,857 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:13:26,857 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:13:26,858 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 09:13:26,859 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 09:13:27,078 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960675_0002_000001 (auth:SIMPLE) 2023-07-14 09:13:28,020 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 09:13:28,461 WARN [Listener at jenkins-hbase9.apache.org/45395] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 09:13:28,464 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-14 09:13:28,467 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-14 09:13:28,579 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 09:13:28,579 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 09:13:29,080 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960675_0003_000001 (auth:SIMPLE) 2023-07-14 09:13:34,486 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960675_0003_000001 (auth:SIMPLE) 2023-07-14 09:13:36,883 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960675_0003_000001 (auth:SIMPLE) 2023-07-14 09:13:40,345 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960675_0003_000001 (auth:SIMPLE) 2023-07-14 09:13:41,898 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 09:13:41,899 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 09:13:41,912 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-14 09:13:41,912 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 09:13:41,913 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 09:13:41,913 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2112291524_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-14 09:13:41,919 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(367): hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-14 09:13:41,919 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(367): hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-14 09:13:41,919 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@2c28278d in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/local-export-1689326006679/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/local-export-1689326006679/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-14 09:13:41,919 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/local-export-1689326006679/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-14 09:13:41,919 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/local-export-1689326006679/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-14 09:13:41,921 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/local-export-1689326006679, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/local-export-1689326006679, srcFsUri=hdfs://localhost:43771, srcDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8 2023-07-14 09:13:41,959 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43771, inputRoot=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8 2023-07-14 09:13:41,960 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@76bccb15, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/local-export-1689326006679, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/local-export-1689326006679/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 09:13:41,960 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43771, inputRoot=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8, snapshotDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-14 09:13:42,004 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/local-export-1689326006679/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 09:13:42,037 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:42,037 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:42,038 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:42,038 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:42,039 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:42,039 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:42,040 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:42,133 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/hadoop-8896908921037775259.jar 2023-07-14 09:13:42,134 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:42,134 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:42,135 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:42,135 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:42,136 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:42,136 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:42,137 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 09:13:42,137 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 09:13:42,138 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 09:13:42,138 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 09:13:42,139 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 09:13:42,139 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 09:13:42,140 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 09:13:42,140 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 09:13:42,141 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 09:13:42,141 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 09:13:42,142 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:13:42,142 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:13:42,143 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 09:13:42,143 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:13:42,143 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:13:42,144 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 09:13:42,144 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 09:13:43,818 WARN [Listener at jenkins-hbase9.apache.org/45395] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 09:13:43,823 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-14 09:13:43,826 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-14 09:13:46,564 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 09:13:46,564 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 09:13:46,568 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960675_0003_000001 (auth:SIMPLE) 2023-07-14 09:13:47,538 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960675_0004_000001 (auth:SIMPLE) 2023-07-14 09:13:55,683 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960675_0004_000001 (auth:SIMPLE) 2023-07-14 09:13:58,123 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960675_0004_000001 (auth:SIMPLE) 2023-07-14 09:14:04,259 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 09:14:04,259 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 09:14:04,274 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-14 09:14:04,274 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 09:14:04,275 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 09:14:04,275 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2112291524_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-14 09:14:04,278 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(367): hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-14 09:14:04,278 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(367): hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-14 09:14:04,278 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@2c28278d in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/local-export-1689326006679/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/local-export-1689326006679/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-14 09:14:04,278 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/local-export-1689326006679/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-14 09:14:04,278 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/local-export-1689326006679/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-14 09:14:04,301 INFO [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-14 09:14:04,302 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testConsecutiveExports 2023-07-14 09:14:04,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-14 09:14:04,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-14 09:14:04,310 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689326044310"}]},"ts":"1689326044310"} 2023-07-14 09:14:04,312 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-14 09:14:04,314 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-14 09:14:04,315 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e8a5c78957fd0c95719e2f1e7ad04d46, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=75047c016f2a8cbbea290c0f580773cd, UNASSIGN}] 2023-07-14 09:14:04,318 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e8a5c78957fd0c95719e2f1e7ad04d46, UNASSIGN 2023-07-14 09:14:04,319 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=75047c016f2a8cbbea290c0f580773cd, UNASSIGN 2023-07-14 09:14:04,324 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=e8a5c78957fd0c95719e2f1e7ad04d46, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:04,324 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=75047c016f2a8cbbea290c0f580773cd, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:04,325 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689326002685.e8a5c78957fd0c95719e2f1e7ad04d46.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689326044324"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689326044324"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689326044324"}]},"ts":"1689326044324"} 2023-07-14 09:14:04,325 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689326002685.75047c016f2a8cbbea290c0f580773cd.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689326044324"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689326044324"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689326044324"}]},"ts":"1689326044324"} 2023-07-14 09:14:04,326 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure e8a5c78957fd0c95719e2f1e7ad04d46, server=jenkins-hbase9.apache.org,45899,1689325949913}] 2023-07-14 09:14:04,328 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 75047c016f2a8cbbea290c0f580773cd, server=jenkins-hbase9.apache.org,37313,1689325949765}] 2023-07-14 09:14:04,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-14 09:14:04,479 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close e8a5c78957fd0c95719e2f1e7ad04d46 2023-07-14 09:14:04,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing e8a5c78957fd0c95719e2f1e7ad04d46, disabling compactions & flushes 2023-07-14 09:14:04,480 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689326002685.e8a5c78957fd0c95719e2f1e7ad04d46. 2023-07-14 09:14:04,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689326002685.e8a5c78957fd0c95719e2f1e7ad04d46. 2023-07-14 09:14:04,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689326002685.e8a5c78957fd0c95719e2f1e7ad04d46. after waiting 0 ms 2023-07-14 09:14:04,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689326002685.e8a5c78957fd0c95719e2f1e7ad04d46. 2023-07-14 09:14:04,480 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 75047c016f2a8cbbea290c0f580773cd 2023-07-14 09:14:04,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 75047c016f2a8cbbea290c0f580773cd, disabling compactions & flushes 2023-07-14 09:14:04,480 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689326002685.75047c016f2a8cbbea290c0f580773cd. 2023-07-14 09:14:04,481 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689326002685.75047c016f2a8cbbea290c0f580773cd. 2023-07-14 09:14:04,481 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689326002685.75047c016f2a8cbbea290c0f580773cd. after waiting 0 ms 2023-07-14 09:14:04,481 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689326002685.75047c016f2a8cbbea290c0f580773cd. 2023-07-14 09:14:04,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testConsecutiveExports/75047c016f2a8cbbea290c0f580773cd/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 09:14:04,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 09:14:04,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testConsecutiveExports/e8a5c78957fd0c95719e2f1e7ad04d46/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 09:14:04,532 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689326002685.75047c016f2a8cbbea290c0f580773cd. 2023-07-14 09:14:04,532 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 75047c016f2a8cbbea290c0f580773cd: 2023-07-14 09:14:04,535 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 75047c016f2a8cbbea290c0f580773cd 2023-07-14 09:14:04,535 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=75047c016f2a8cbbea290c0f580773cd, regionState=CLOSED 2023-07-14 09:14:04,536 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689326002685.75047c016f2a8cbbea290c0f580773cd.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689326044535"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689326044535"}]},"ts":"1689326044535"} 2023-07-14 09:14:04,539 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 09:14:04,541 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689326002685.e8a5c78957fd0c95719e2f1e7ad04d46. 2023-07-14 09:14:04,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for e8a5c78957fd0c95719e2f1e7ad04d46: 2023-07-14 09:14:04,543 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=53 2023-07-14 09:14:04,543 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 75047c016f2a8cbbea290c0f580773cd, server=jenkins-hbase9.apache.org,37313,1689325949765 in 209 msec 2023-07-14 09:14:04,544 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed e8a5c78957fd0c95719e2f1e7ad04d46 2023-07-14 09:14:04,545 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=75047c016f2a8cbbea290c0f580773cd, UNASSIGN in 228 msec 2023-07-14 09:14:04,546 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=e8a5c78957fd0c95719e2f1e7ad04d46, regionState=CLOSED 2023-07-14 09:14:04,546 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689326002685.e8a5c78957fd0c95719e2f1e7ad04d46.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689326044546"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689326044546"}]},"ts":"1689326044546"} 2023-07-14 09:14:04,551 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=52 2023-07-14 09:14:04,551 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure e8a5c78957fd0c95719e2f1e7ad04d46, server=jenkins-hbase9.apache.org,45899,1689325949913 in 222 msec 2023-07-14 09:14:04,553 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-07-14 09:14:04,553 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e8a5c78957fd0c95719e2f1e7ad04d46, UNASSIGN in 236 msec 2023-07-14 09:14:04,554 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689326044554"}]},"ts":"1689326044554"} 2023-07-14 09:14:04,556 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-14 09:14:04,559 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-14 09:14:04,563 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 258 msec 2023-07-14 09:14:04,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-14 09:14:04,612 INFO [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-14 09:14:04,614 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testConsecutiveExports 2023-07-14 09:14:04,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-14 09:14:04,621 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-14 09:14:04,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-14 09:14:04,624 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-14 09:14:04,627 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41875] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-14 09:14:04,631 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 09:14:04,631 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 09:14:04,632 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 09:14:04,632 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-14 09:14:04,632 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-14 09:14:04,633 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-14 09:14:04,635 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 09:14:04,635 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:04,636 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 09:14:04,636 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:04,636 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 09:14:04,636 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:04,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-14 09:14:04,637 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testConsecutiveExports/e8a5c78957fd0c95719e2f1e7ad04d46 2023-07-14 09:14:04,638 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 09:14:04,638 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:04,640 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-07-14 09:14:04,640 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-14 09:14:04,654 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testConsecutiveExports/e8a5c78957fd0c95719e2f1e7ad04d46/cf, FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testConsecutiveExports/e8a5c78957fd0c95719e2f1e7ad04d46/recovered.edits] 2023-07-14 09:14:04,657 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testConsecutiveExports/75047c016f2a8cbbea290c0f580773cd 2023-07-14 09:14:04,662 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testConsecutiveExports/75047c016f2a8cbbea290c0f580773cd/cf, FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testConsecutiveExports/75047c016f2a8cbbea290c0f580773cd/recovered.edits] 2023-07-14 09:14:04,663 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testConsecutiveExports/e8a5c78957fd0c95719e2f1e7ad04d46/cf/beafb9414f734197862a770361238743 to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/archive/data/default/testtb-testConsecutiveExports/e8a5c78957fd0c95719e2f1e7ad04d46/cf/beafb9414f734197862a770361238743 2023-07-14 09:14:04,668 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testConsecutiveExports/e8a5c78957fd0c95719e2f1e7ad04d46/recovered.edits/9.seqid to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/archive/data/default/testtb-testConsecutiveExports/e8a5c78957fd0c95719e2f1e7ad04d46/recovered.edits/9.seqid 2023-07-14 09:14:04,670 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testConsecutiveExports/75047c016f2a8cbbea290c0f580773cd/cf/784220ba1931460d88b4f17d3e773a57 to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/archive/data/default/testtb-testConsecutiveExports/75047c016f2a8cbbea290c0f580773cd/cf/784220ba1931460d88b4f17d3e773a57 2023-07-14 09:14:04,676 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testConsecutiveExports/75047c016f2a8cbbea290c0f580773cd/recovered.edits/9.seqid to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/archive/data/default/testtb-testConsecutiveExports/75047c016f2a8cbbea290c0f580773cd/recovered.edits/9.seqid 2023-07-14 09:14:04,676 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testConsecutiveExports/e8a5c78957fd0c95719e2f1e7ad04d46 2023-07-14 09:14:04,676 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testConsecutiveExports/75047c016f2a8cbbea290c0f580773cd 2023-07-14 09:14:04,676 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-14 09:14:04,677 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-14 09:14:04,678 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-14 09:14:04,683 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071465bd68e9de2a4fc38af1371860c15bd1 to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071465bd68e9de2a4fc38af1371860c15bd1 2023-07-14 09:14:04,687 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307142bf1ecfe9bd5403bb057a9055e191cd6 to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307142bf1ecfe9bd5403bb057a9055e191cd6 2023-07-14 09:14:04,688 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-14 09:14:04,693 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-14 09:14:04,696 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-14 09:14:04,700 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-14 09:14:04,702 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-14 09:14:04,702 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-14 09:14:04,702 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689326002685.e8a5c78957fd0c95719e2f1e7ad04d46.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689326044702"}]},"ts":"9223372036854775807"} 2023-07-14 09:14:04,703 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689326002685.75047c016f2a8cbbea290c0f580773cd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689326044702"}]},"ts":"9223372036854775807"} 2023-07-14 09:14:04,712 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 09:14:04,712 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e8a5c78957fd0c95719e2f1e7ad04d46, NAME => 'testtb-testConsecutiveExports,,1689326002685.e8a5c78957fd0c95719e2f1e7ad04d46.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 75047c016f2a8cbbea290c0f580773cd, NAME => 'testtb-testConsecutiveExports,1,1689326002685.75047c016f2a8cbbea290c0f580773cd.', STARTKEY => '1', ENDKEY => ''}] 2023-07-14 09:14:04,712 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-14 09:14:04,712 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689326044712"}]},"ts":"9223372036854775807"} 2023-07-14 09:14:04,716 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-14 09:14:04,718 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-14 09:14:04,721 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 104 msec 2023-07-14 09:14:04,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-14 09:14:04,738 INFO [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-14 09:14:04,749 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-14 09:14:04,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-14 09:14:04,766 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testConsecutiveExports" 2023-07-14 09:14:04,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-14 09:14:04,817 INFO [Listener at jenkins-hbase9.apache.org/45395] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=744 (was 763), OpenFileDescriptor=900 (was 926), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=838 (was 691) - SystemLoadAverage LEAK? -, ProcessCount=192 (was 190) - ProcessCount LEAK? -, AvailableMemoryMB=1346 (was 1297) - AvailableMemoryMB LEAK? - 2023-07-14 09:14:04,817 WARN [Listener at jenkins-hbase9.apache.org/45395] hbase.ResourceChecker(130): Thread=744 is superior to 500 2023-07-14 09:14:04,870 INFO [Listener at jenkins-hbase9.apache.org/45395] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=744, OpenFileDescriptor=900, MaxFileDescriptor=60000, SystemLoadAverage=838, ProcessCount=192, AvailableMemoryMB=1343 2023-07-14 09:14:04,870 WARN [Listener at jenkins-hbase9.apache.org/45395] hbase.ResourceChecker(130): Thread=744 is superior to 500 2023-07-14 09:14:04,872 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-14 09:14:04,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,878 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 09:14:04,878 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-14 09:14:04,879 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 09:14:04,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-14 09:14:04,886 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/da15be0ffbf23d00411aeb89550b8a65 2023-07-14 09:14:04,889 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d058974e29817d70d499efa41b4a43e5 2023-07-14 09:14:04,889 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/da15be0ffbf23d00411aeb89550b8a65 empty. 2023-07-14 09:14:04,890 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d058974e29817d70d499efa41b4a43e5 empty. 2023-07-14 09:14:04,890 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/da15be0ffbf23d00411aeb89550b8a65 2023-07-14 09:14:04,891 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d058974e29817d70d499efa41b4a43e5 2023-07-14 09:14:04,891 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-14 09:14:04,926 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-14 09:14:04,929 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => da15be0ffbf23d00411aeb89550b8a65, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689326044872.da15be0ffbf23d00411aeb89550b8a65.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp 2023-07-14 09:14:04,929 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => d058974e29817d70d499efa41b4a43e5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689326044872.d058974e29817d70d499efa41b4a43e5.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp 2023-07-14 09:14:04,971 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689326044872.d058974e29817d70d499efa41b4a43e5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:14:04,971 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing d058974e29817d70d499efa41b4a43e5, disabling compactions & flushes 2023-07-14 09:14:04,971 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689326044872.d058974e29817d70d499efa41b4a43e5. 2023-07-14 09:14:04,971 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689326044872.d058974e29817d70d499efa41b4a43e5. 2023-07-14 09:14:04,971 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689326044872.d058974e29817d70d499efa41b4a43e5. after waiting 0 ms 2023-07-14 09:14:04,971 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689326044872.d058974e29817d70d499efa41b4a43e5. 2023-07-14 09:14:04,971 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689326044872.d058974e29817d70d499efa41b4a43e5. 2023-07-14 09:14:04,971 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for d058974e29817d70d499efa41b4a43e5: 2023-07-14 09:14:04,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-14 09:14:04,988 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689326044872.da15be0ffbf23d00411aeb89550b8a65.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:14:04,988 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing da15be0ffbf23d00411aeb89550b8a65, disabling compactions & flushes 2023-07-14 09:14:04,988 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689326044872.da15be0ffbf23d00411aeb89550b8a65. 2023-07-14 09:14:04,988 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689326044872.da15be0ffbf23d00411aeb89550b8a65. 2023-07-14 09:14:04,988 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689326044872.da15be0ffbf23d00411aeb89550b8a65. after waiting 0 ms 2023-07-14 09:14:04,988 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689326044872.da15be0ffbf23d00411aeb89550b8a65. 2023-07-14 09:14:04,988 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689326044872.da15be0ffbf23d00411aeb89550b8a65. 2023-07-14 09:14:04,988 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for da15be0ffbf23d00411aeb89550b8a65: 2023-07-14 09:14:04,992 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 09:14:04,993 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689326044872.d058974e29817d70d499efa41b4a43e5.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689326044992"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689326044992"}]},"ts":"1689326044992"} 2023-07-14 09:14:04,993 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689326044872.da15be0ffbf23d00411aeb89550b8a65.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689326044992"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689326044992"}]},"ts":"1689326044992"} 2023-07-14 09:14:05,000 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 09:14:05,001 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 09:14:05,002 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689326045002"}]},"ts":"1689326045002"} 2023-07-14 09:14:05,005 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-14 09:14:05,009 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 09:14:05,010 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 09:14:05,010 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 09:14:05,010 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 09:14:05,010 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 09:14:05,010 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=da15be0ffbf23d00411aeb89550b8a65, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d058974e29817d70d499efa41b4a43e5, ASSIGN}] 2023-07-14 09:14:05,013 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d058974e29817d70d499efa41b4a43e5, ASSIGN 2023-07-14 09:14:05,014 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=da15be0ffbf23d00411aeb89550b8a65, ASSIGN 2023-07-14 09:14:05,022 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=da15be0ffbf23d00411aeb89550b8a65, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45899,1689325949913; forceNewPlan=false, retain=false 2023-07-14 09:14:05,022 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d058974e29817d70d499efa41b4a43e5, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,41875,1689325950034; forceNewPlan=false, retain=false 2023-07-14 09:14:05,172 INFO [jenkins-hbase9:41733] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 09:14:05,176 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=d058974e29817d70d499efa41b4a43e5, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:05,176 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=da15be0ffbf23d00411aeb89550b8a65, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:05,176 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689326044872.d058974e29817d70d499efa41b4a43e5.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689326045176"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689326045176"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689326045176"}]},"ts":"1689326045176"} 2023-07-14 09:14:05,176 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689326044872.da15be0ffbf23d00411aeb89550b8a65.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689326045176"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689326045176"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689326045176"}]},"ts":"1689326045176"} 2023-07-14 09:14:05,178 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure d058974e29817d70d499efa41b4a43e5, server=jenkins-hbase9.apache.org,41875,1689325950034}] 2023-07-14 09:14:05,179 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure da15be0ffbf23d00411aeb89550b8a65, server=jenkins-hbase9.apache.org,45899,1689325949913}] 2023-07-14 09:14:05,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-14 09:14:05,339 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689326044872.da15be0ffbf23d00411aeb89550b8a65. 2023-07-14 09:14:05,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => da15be0ffbf23d00411aeb89550b8a65, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689326044872.da15be0ffbf23d00411aeb89550b8a65.', STARTKEY => '', ENDKEY => '1'} 2023-07-14 09:14:05,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689326044872.da15be0ffbf23d00411aeb89550b8a65. service=AccessControlService 2023-07-14 09:14:05,340 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 09:14:05,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion da15be0ffbf23d00411aeb89550b8a65 2023-07-14 09:14:05,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689326044872.da15be0ffbf23d00411aeb89550b8a65.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:14:05,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for da15be0ffbf23d00411aeb89550b8a65 2023-07-14 09:14:05,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for da15be0ffbf23d00411aeb89550b8a65 2023-07-14 09:14:05,342 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689326044872.d058974e29817d70d499efa41b4a43e5. 2023-07-14 09:14:05,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d058974e29817d70d499efa41b4a43e5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689326044872.d058974e29817d70d499efa41b4a43e5.', STARTKEY => '1', ENDKEY => ''} 2023-07-14 09:14:05,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689326044872.d058974e29817d70d499efa41b4a43e5. service=AccessControlService 2023-07-14 09:14:05,342 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 09:14:05,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion d058974e29817d70d499efa41b4a43e5 2023-07-14 09:14:05,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689326044872.d058974e29817d70d499efa41b4a43e5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:14:05,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for d058974e29817d70d499efa41b4a43e5 2023-07-14 09:14:05,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for d058974e29817d70d499efa41b4a43e5 2023-07-14 09:14:05,350 INFO [StoreOpener-da15be0ffbf23d00411aeb89550b8a65-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region da15be0ffbf23d00411aeb89550b8a65 2023-07-14 09:14:05,350 INFO [StoreOpener-d058974e29817d70d499efa41b4a43e5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d058974e29817d70d499efa41b4a43e5 2023-07-14 09:14:05,353 DEBUG [StoreOpener-d058974e29817d70d499efa41b4a43e5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion/d058974e29817d70d499efa41b4a43e5/cf 2023-07-14 09:14:05,353 DEBUG [StoreOpener-d058974e29817d70d499efa41b4a43e5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion/d058974e29817d70d499efa41b4a43e5/cf 2023-07-14 09:14:05,355 INFO [StoreOpener-d058974e29817d70d499efa41b4a43e5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d058974e29817d70d499efa41b4a43e5 columnFamilyName cf 2023-07-14 09:14:05,355 DEBUG [StoreOpener-da15be0ffbf23d00411aeb89550b8a65-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion/da15be0ffbf23d00411aeb89550b8a65/cf 2023-07-14 09:14:05,355 DEBUG [StoreOpener-da15be0ffbf23d00411aeb89550b8a65-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion/da15be0ffbf23d00411aeb89550b8a65/cf 2023-07-14 09:14:05,355 INFO [StoreOpener-da15be0ffbf23d00411aeb89550b8a65-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region da15be0ffbf23d00411aeb89550b8a65 columnFamilyName cf 2023-07-14 09:14:05,357 INFO [StoreOpener-d058974e29817d70d499efa41b4a43e5-1] regionserver.HStore(310): Store=d058974e29817d70d499efa41b4a43e5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 09:14:05,357 INFO [StoreOpener-da15be0ffbf23d00411aeb89550b8a65-1] regionserver.HStore(310): Store=da15be0ffbf23d00411aeb89550b8a65/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 09:14:05,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion/d058974e29817d70d499efa41b4a43e5 2023-07-14 09:14:05,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion/da15be0ffbf23d00411aeb89550b8a65 2023-07-14 09:14:05,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion/d058974e29817d70d499efa41b4a43e5 2023-07-14 09:14:05,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion/da15be0ffbf23d00411aeb89550b8a65 2023-07-14 09:14:05,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for d058974e29817d70d499efa41b4a43e5 2023-07-14 09:14:05,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for da15be0ffbf23d00411aeb89550b8a65 2023-07-14 09:14:05,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion/d058974e29817d70d499efa41b4a43e5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 09:14:05,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion/da15be0ffbf23d00411aeb89550b8a65/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 09:14:05,378 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened d058974e29817d70d499efa41b4a43e5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66743265, jitterRate=-0.005447849631309509}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 09:14:05,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for d058974e29817d70d499efa41b4a43e5: 2023-07-14 09:14:05,378 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened da15be0ffbf23d00411aeb89550b8a65; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74715767, jitterRate=0.11335168778896332}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 09:14:05,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for da15be0ffbf23d00411aeb89550b8a65: 2023-07-14 09:14:05,381 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689326044872.d058974e29817d70d499efa41b4a43e5., pid=60, masterSystemTime=1689326045333 2023-07-14 09:14:05,381 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689326044872.da15be0ffbf23d00411aeb89550b8a65., pid=61, masterSystemTime=1689326045333 2023-07-14 09:14:05,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689326044872.da15be0ffbf23d00411aeb89550b8a65. 2023-07-14 09:14:05,388 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689326044872.da15be0ffbf23d00411aeb89550b8a65. 2023-07-14 09:14:05,388 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=da15be0ffbf23d00411aeb89550b8a65, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:05,388 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689326044872.da15be0ffbf23d00411aeb89550b8a65.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689326045388"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689326045388"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689326045388"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689326045388"}]},"ts":"1689326045388"} 2023-07-14 09:14:05,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689326044872.d058974e29817d70d499efa41b4a43e5. 2023-07-14 09:14:05,389 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689326044872.d058974e29817d70d499efa41b4a43e5. 2023-07-14 09:14:05,390 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=d058974e29817d70d499efa41b4a43e5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:05,390 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689326044872.d058974e29817d70d499efa41b4a43e5.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689326045390"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689326045390"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689326045390"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689326045390"}]},"ts":"1689326045390"} 2023-07-14 09:14:05,393 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-14 09:14:05,393 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure da15be0ffbf23d00411aeb89550b8a65, server=jenkins-hbase9.apache.org,45899,1689325949913 in 212 msec 2023-07-14 09:14:05,394 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-14 09:14:05,394 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure d058974e29817d70d499efa41b4a43e5, server=jenkins-hbase9.apache.org,41875,1689325950034 in 213 msec 2023-07-14 09:14:05,396 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=da15be0ffbf23d00411aeb89550b8a65, ASSIGN in 383 msec 2023-07-14 09:14:05,398 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-14 09:14:05,398 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d058974e29817d70d499efa41b4a43e5, ASSIGN in 384 msec 2023-07-14 09:14:05,399 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 09:14:05,399 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689326045399"}]},"ts":"1689326045399"} 2023-07-14 09:14:05,400 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-14 09:14:05,404 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 09:14:05,404 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-14 09:14:05,407 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41875] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-14 09:14:05,410 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:05,410 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:05,410 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:05,410 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:05,413 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 09:14:05,413 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,413 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 09:14:05,414 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,415 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 09:14:05,417 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 09:14:05,425 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 546 msec 2023-07-14 09:14:05,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-14 09:14:05,487 INFO [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-14 09:14:05,490 DEBUG [Listener at jenkins-hbase9.apache.org/45395] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,490 DEBUG [Listener at jenkins-hbase9.apache.org/45395] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689326044872.da15be0ffbf23d00411aeb89550b8a65. 2023-07-14 09:14:05,493 INFO [Listener at jenkins-hbase9.apache.org/45395] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 09:14:05,523 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-14 09:14:05,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689326045523 (current time:1689326045523). 2023-07-14 09:14:05,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 09:14:05,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] zookeeper.ReadOnlyZKClient(139): Connect 0x4987c6d9 to 127.0.0.1:59920 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:14:05,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@446f20bb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:14:05,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:14:05,555 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:39344, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:14:05,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4987c6d9 to 127.0.0.1:59920 2023-07-14 09:14:05,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:14:05,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] zookeeper.ReadOnlyZKClient(139): Connect 0x034d2a03 to 127.0.0.1:59920 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:14:05,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@748b85bd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:14:05,593 DEBUG [hconnection-0x495c096f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:14:05,594 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:39352, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:14:05,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:14:05,604 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:59982, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:14:05,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x034d2a03 to 127.0.0.1:59920 2023-07-14 09:14:05,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:14:05,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-14 09:14:05,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 09:14:05,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-14 09:14:05,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-14 09:14:05,615 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-14 09:14:05,622 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689326645622 2023-07-14 09:14:05,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-14 09:14:05,622 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,624 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 09:14:05,624 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 09:14:05,630 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-14 09:14:05,631 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-14 09:14:05,633 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 17 msec 2023-07-14 09:14:05,635 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-14 09:14:05,637 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689326645637 2023-07-14 09:14:05,671 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,671 INFO [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-14 09:14:05,671 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:05,673 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-14 09:14:05,673 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-14 09:14:05,673 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,673 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,675 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:05,675 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:05,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:05,675 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:05,675 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:05,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:05,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:05,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:05,676 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:05,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:05,676 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:05,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:05,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,677 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:05,677 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 09:14:05,677 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,677 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,677 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-14 09:14:05,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-14 09:14:05,677 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-14 09:14:05,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-14 09:14:05,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,678 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-14 09:14:05,678 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-14 09:14:05,678 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,678 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-14 09:14:05,678 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:05,678 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,678 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,680 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-14 09:14:05,680 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-14 09:14:05,679 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-14 09:14:05,680 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:05,680 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:05,681 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-14 09:14:05,682 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-14 09:14:05,682 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45899,1689325949913' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-14 09:14:05,680 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-14 09:14:05,682 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41875,1689325950034' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-14 09:14:05,682 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-14 09:14:05,682 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-14 09:14:05,683 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,37313,1689325949765' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-14 09:14:05,684 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,685 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:05,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:05,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:05,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:05,685 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,685 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:14:05,685 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:05,685 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,686 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,686 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,686 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:14:05,686 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,686 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:14:05,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:05,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:05,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:05,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:05,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:05,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:05,691 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45899,1689325949913' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-14 09:14:05,691 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1680e475[Count = 1] remaining members to acquire global barrier 2023-07-14 09:14:05,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:05,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:05,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:05,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:05,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:05,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:05,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:05,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:05,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:05,693 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,41875,1689325950034' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-14 09:14:05,694 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1680e475[Count = 0] remaining members to acquire global barrier 2023-07-14 09:14:05,694 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-14 09:14:05,694 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,696 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,696 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,696 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,696 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-14 09:14:05,696 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-14 09:14:05,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,696 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-14 09:14:05,696 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-14 09:14:05,696 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,37313,1689325949765' in zk 2023-07-14 09:14:05,702 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:05,705 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 09:14:05,706 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 09:14:05,706 DEBUG [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689326044872.d058974e29817d70d499efa41b4a43e5. 2023-07-14 09:14:05,706 DEBUG [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689326044872.d058974e29817d70d499efa41b4a43e5. started... 2023-07-14 09:14:05,709 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 09:14:05,709 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 09:14:05,710 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689326044872.da15be0ffbf23d00411aeb89550b8a65. 2023-07-14 09:14:05,712 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-14 09:14:05,714 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:05,714 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-14 09:14:05,714 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689326044872.da15be0ffbf23d00411aeb89550b8a65. started... 2023-07-14 09:14:05,714 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for da15be0ffbf23d00411aeb89550b8a65: 2023-07-14 09:14:05,714 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689326044872.da15be0ffbf23d00411aeb89550b8a65.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,714 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 09:14:05,714 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 09:14:05,720 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:05,720 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 09:14:05,720 DEBUG [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d058974e29817d70d499efa41b4a43e5: 2023-07-14 09:14:05,720 DEBUG [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689326044872.d058974e29817d70d499efa41b4a43e5.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,720 DEBUG [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 09:14:05,721 DEBUG [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 09:14:05,724 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:14:05,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 09:14:05,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:14:05,726 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 09:14:05,783 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689326044872.da15be0ffbf23d00411aeb89550b8a65. completed. 2023-07-14 09:14:05,783 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689326044872.da15be0ffbf23d00411aeb89550b8a65. 2023-07-14 09:14:05,783 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 09:14:05,783 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 09:14:05,783 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:05,783 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-14 09:14:05,783 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,45899,1689325949913' in zk 2023-07-14 09:14:05,785 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-14 09:14:05,785 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:05,785 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:05,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:05,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:05,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:05,785 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-14 09:14:05,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:05,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:05,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:05,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:05,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:05,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:05,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:05,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:05,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,45899,1689325949913': 2023-07-14 09:14:05,790 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45899,1689325949913' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-14 09:14:05,798 DEBUG [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689326044872.d058974e29817d70d499efa41b4a43e5. completed. 2023-07-14 09:14:05,798 DEBUG [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689326044872.d058974e29817d70d499efa41b4a43e5. 2023-07-14 09:14:05,798 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 09:14:05,798 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 09:14:05,798 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:05,799 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-14 09:14:05,799 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,41875,1689325950034' in zk 2023-07-14 09:14:05,800 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:05,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:05,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:05,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:05,801 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-14 09:14:05,801 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:05,801 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-14 09:14:05,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:05,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:05,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:05,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:05,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:05,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:05,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:05,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:05,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:05,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,41875,1689325950034': 2023-07-14 09:14:05,817 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,41875,1689325950034' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-14 09:14:05,817 INFO [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-14 09:14:05,817 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 09:14:05,817 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 09:14:05,817 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,817 INFO [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 09:14:05,819 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,819 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:05,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:05,819 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:05,819 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,819 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,820 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:05,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,820 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:05,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:05,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:05,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:05,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:05,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:05,821 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:05,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:05,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:05,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,821 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:05,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:05,822 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:05,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:05,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:05,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:05,824 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:05,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:05,825 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:05,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,825 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:05,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:05,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:05,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:05,829 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:05,829 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:05,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:05,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:05,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:05,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:05,829 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:05,829 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,829 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:05,829 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:05,829 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,829 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:05,829 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:05,831 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,831 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:05,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:05,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:05,831 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:05,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:05,831 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-14 09:14:05,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:05,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:05,831 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:05,832 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:05,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:05,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:05,832 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,832 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:05,832 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,832 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:05,832 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:05,832 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,832 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,833 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-14 09:14:05,845 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,846 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,889 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,926 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:14:05,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 09:14:05,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:14:05,928 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 09:14:05,967 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-14 09:14:05,967 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,968 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,968 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689326045622Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689326045845 (+223 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689326045845Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689326045845Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689326045855 (+10 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689326045882 (+27 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689326045967 (+85 ms) 2023-07-14 09:14:05,973 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-14 09:14:05,979 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 350 msec 2023-07-14 09:14:06,228 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:14:06,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 09:14:06,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 09:14:06,238 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45899] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689326044872.da15be0ffbf23d00411aeb89550b8a65. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 09:14:06,239 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41875] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689326044872.d058974e29817d70d499efa41b4a43e5. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 09:14:06,242 DEBUG [Listener at jenkins-hbase9.apache.org/45395] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:06,242 DEBUG [Listener at jenkins-hbase9.apache.org/45395] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689326044872.da15be0ffbf23d00411aeb89550b8a65. 2023-07-14 09:14:06,243 INFO [Listener at jenkins-hbase9.apache.org/45395] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 09:14:06,258 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-14 09:14:06,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689326046258 (current time:1689326046258). 2023-07-14 09:14:06,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 09:14:06,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] zookeeper.ReadOnlyZKClient(139): Connect 0x7b42b599 to 127.0.0.1:59920 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:14:06,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@427d349e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:14:06,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:14:06,272 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:39366, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:14:06,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7b42b599 to 127.0.0.1:59920 2023-07-14 09:14:06,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:14:06,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] zookeeper.ReadOnlyZKClient(139): Connect 0x1c89b7ea to 127.0.0.1:59920 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:14:06,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7209279f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:14:06,295 DEBUG [hconnection-0x59fb3484-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:14:06,299 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:39378, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:14:06,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:14:06,309 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:59996, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:14:06,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1c89b7ea to 127.0.0.1:59920 2023-07-14 09:14:06,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:14:06,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-14 09:14:06,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 09:14:06,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-14 09:14:06,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-14 09:14:06,318 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-14 09:14:06,319 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689326646319 2023-07-14 09:14:06,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-14 09:14:06,319 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:06,321 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 09:14:06,321 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 09:14:06,322 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-14 09:14:06,327 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-14 09:14:06,330 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 7 msec 2023-07-14 09:14:06,331 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-14 09:14:06,332 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689326646332 2023-07-14 09:14:06,364 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:06,364 INFO [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-14 09:14:06,364 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:06,366 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-14 09:14:06,366 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-14 09:14:06,416 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:06,416 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:06,418 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:06,418 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:06,418 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:06,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:06,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:06,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:06,418 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:06,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:06,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:06,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:06,419 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:06,419 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:06,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:06,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:06,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:06,420 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:06,420 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:06,420 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 09:14:06,420 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:06,420 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:06,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-14 09:14:06,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:06,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-14 09:14:06,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:06,420 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-14 09:14:06,421 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-14 09:14:06,422 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:14:06,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-14 09:14:06,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:06,424 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-14 09:14:06,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 09:14:06,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:14:06,424 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 09:14:06,434 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:06,434 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-14 09:14:06,434 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:06,434 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:06,434 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-14 09:14:06,434 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:06,438 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:06,438 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-14 09:14:06,444 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-14 09:14:06,445 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-14 09:14:06,445 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45899,1689325949913' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-14 09:14:06,444 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-14 09:14:06,445 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-14 09:14:06,445 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:06,445 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,37313,1689325949765' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-14 09:14:06,447 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-14 09:14:06,447 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-14 09:14:06,447 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41875,1689325950034' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-14 09:14:06,448 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:06,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:06,448 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:06,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:06,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:06,449 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:06,450 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:06,450 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:06,450 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:14:06,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:06,450 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:06,450 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:14:06,450 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:06,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:06,451 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:06,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:06,451 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:14:06,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:06,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:06,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:06,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:06,453 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45899,1689325949913' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-14 09:14:06,453 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3444192b[Count = 1] remaining members to acquire global barrier 2023-07-14 09:14:06,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:06,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:06,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:06,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:06,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:06,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:06,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:06,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:06,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:06,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:06,455 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,41875,1689325950034' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-14 09:14:06,455 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3444192b[Count = 0] remaining members to acquire global barrier 2023-07-14 09:14:06,455 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-14 09:14:06,456 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:06,456 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:06,457 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:06,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:06,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:06,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:06,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:06,457 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:06,457 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-14 09:14:06,457 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-14 09:14:06,457 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-14 09:14:06,457 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,37313,1689325949765' in zk 2023-07-14 09:14:06,457 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:06,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:06,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:06,457 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:06,457 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-14 09:14:06,457 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 09:14:06,459 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-14 09:14:06,459 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:06,459 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-14 09:14:06,462 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 09:14:06,471 DEBUG [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689326044872.d058974e29817d70d499efa41b4a43e5. 2023-07-14 09:14:06,471 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 09:14:06,471 DEBUG [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689326044872.d058974e29817d70d499efa41b4a43e5. started... 2023-07-14 09:14:06,471 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 09:14:06,471 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 09:14:06,471 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689326044872.da15be0ffbf23d00411aeb89550b8a65. 2023-07-14 09:14:06,471 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689326044872.da15be0ffbf23d00411aeb89550b8a65. started... 2023-07-14 09:14:06,471 INFO [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d058974e29817d70d499efa41b4a43e5 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-14 09:14:06,471 INFO [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] regionserver.HRegion(2745): Flushing da15be0ffbf23d00411aeb89550b8a65 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-14 09:14:06,541 INFO [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071422ecf2cfb86c4d13a4727cad3fac483d to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023071422ecf2cfb86c4d13a4727cad3fac483d 2023-07-14 09:14:06,587 INFO [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion/da15be0ffbf23d00411aeb89550b8a65/.tmp/cf/d8b7b8582ef248e38020dc4ea4ddbd3a 2023-07-14 09:14:06,599 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion/da15be0ffbf23d00411aeb89550b8a65/.tmp/cf/d8b7b8582ef248e38020dc4ea4ddbd3a as hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion/da15be0ffbf23d00411aeb89550b8a65/cf/d8b7b8582ef248e38020dc4ea4ddbd3a 2023-07-14 09:14:06,608 INFO [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion/da15be0ffbf23d00411aeb89550b8a65/cf/d8b7b8582ef248e38020dc4ea4ddbd3a, entries=4, sequenceid=6, filesize=5.6 K 2023-07-14 09:14:06,609 INFO [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for da15be0ffbf23d00411aeb89550b8a65 in 138ms, sequenceid=6, compaction requested=false 2023-07-14 09:14:06,609 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-14 09:14:06,610 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for da15be0ffbf23d00411aeb89550b8a65: 2023-07-14 09:14:06,610 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689326044872.da15be0ffbf23d00411aeb89550b8a65.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:06,610 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 09:14:06,610 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion/da15be0ffbf23d00411aeb89550b8a65/cf/d8b7b8582ef248e38020dc4ea4ddbd3a] hfiles 2023-07-14 09:14:06,610 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion/da15be0ffbf23d00411aeb89550b8a65/cf/d8b7b8582ef248e38020dc4ea4ddbd3a for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:06,624 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:14:06,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 09:14:06,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:14:06,635 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 09:14:06,640 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689326044872.da15be0ffbf23d00411aeb89550b8a65. completed. 2023-07-14 09:14:06,640 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689326044872.da15be0ffbf23d00411aeb89550b8a65. 2023-07-14 09:14:06,640 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 09:14:06,640 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 09:14:06,641 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:06,641 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-14 09:14:06,641 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,45899,1689325949913' in zk 2023-07-14 09:14:06,644 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-14 09:14:06,644 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:06,644 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:06,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:06,644 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-14 09:14:06,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:06,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:06,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:06,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:06,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:06,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:06,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:06,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:06,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:06,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:06,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:06,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:06,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,45899,1689325949913': 2023-07-14 09:14:06,652 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45899,1689325949913' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-14 09:14:06,935 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:14:06,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 09:14:06,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:14:06,937 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-14 09:14:06,946 INFO [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230714a5f18789eff74a9d8732c63a084e3566 to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230714a5f18789eff74a9d8732c63a084e3566 2023-07-14 09:14:07,013 INFO [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion/d058974e29817d70d499efa41b4a43e5/.tmp/cf/6e86d5a0b1c948a99c204e21153c1ed6 2023-07-14 09:14:07,027 DEBUG [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion/d058974e29817d70d499efa41b4a43e5/.tmp/cf/6e86d5a0b1c948a99c204e21153c1ed6 as hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion/d058974e29817d70d499efa41b4a43e5/cf/6e86d5a0b1c948a99c204e21153c1ed6 2023-07-14 09:14:07,041 INFO [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion/d058974e29817d70d499efa41b4a43e5/cf/6e86d5a0b1c948a99c204e21153c1ed6, entries=46, sequenceid=6, filesize=13.3 K 2023-07-14 09:14:07,042 INFO [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for d058974e29817d70d499efa41b4a43e5 in 571ms, sequenceid=6, compaction requested=false 2023-07-14 09:14:07,044 DEBUG [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d058974e29817d70d499efa41b4a43e5: 2023-07-14 09:14:07,044 DEBUG [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689326044872.d058974e29817d70d499efa41b4a43e5.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:07,044 DEBUG [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 09:14:07,044 DEBUG [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion/d058974e29817d70d499efa41b4a43e5/cf/6e86d5a0b1c948a99c204e21153c1ed6] hfiles 2023-07-14 09:14:07,045 DEBUG [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion/d058974e29817d70d499efa41b4a43e5/cf/6e86d5a0b1c948a99c204e21153c1ed6 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:07,180 DEBUG [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689326044872.d058974e29817d70d499efa41b4a43e5. completed. 2023-07-14 09:14:07,181 DEBUG [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689326044872.d058974e29817d70d499efa41b4a43e5. 2023-07-14 09:14:07,181 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 09:14:07,181 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 09:14:07,181 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:07,181 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-14 09:14:07,181 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,41875,1689325950034' in zk 2023-07-14 09:14:07,184 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:07,184 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-14 09:14:07,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:07,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:07,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:07,185 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:07,185 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-14 09:14:07,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:07,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:07,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:07,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:07,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:07,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:07,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:07,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:07,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:07,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:07,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:07,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,41875,1689325950034': 2023-07-14 09:14:07,195 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,41875,1689325950034' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-14 09:14:07,195 INFO [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-14 09:14:07,196 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 09:14:07,196 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 09:14:07,196 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:07,196 INFO [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 09:14:07,202 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:07,202 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:07,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:07,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:07,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:07,202 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:07,202 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:07,202 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:07,202 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:07,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:07,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:07,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:07,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:07,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:07,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:07,203 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:07,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:07,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:07,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:07,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:07,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:07,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:07,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:07,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:07,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:07,205 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:07,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:07,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:07,206 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:07,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:07,207 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:07,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:07,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:07,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:07,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:07,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:07,210 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:07,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:07,210 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:07,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:07,211 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:07,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:07,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:07,219 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:07,219 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:07,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:07,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:07,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:07,219 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:07,219 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:07,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:07,220 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:07,220 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:07,220 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:07,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:07,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:07,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:07,220 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:07,220 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:07,220 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:07,227 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:07,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:07,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:07,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:07,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:07,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:07,227 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:07,228 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-14 09:14:07,227 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:07,228 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:07,228 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:07,228 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:07,228 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:07,228 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:07,228 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:07,228 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:07,228 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:07,229 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230714a5f18789eff74a9d8732c63a084e3566, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023071422ecf2cfb86c4d13a4727cad3fac483d] mob files 2023-07-14 09:14:07,229 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230714a5f18789eff74a9d8732c63a084e3566 2023-07-14 09:14:07,229 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023071422ecf2cfb86c4d13a4727cad3fac483d 2023-07-14 09:14:07,286 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:07,287 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:07,404 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:07,437 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:14:07,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 09:14:07,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:14:07,438 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-14 09:14:07,497 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-14 09:14:07,497 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:07,497 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:07,497 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689326046320Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689326047286 (+966 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689326047286Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689326047286Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689326047315 (+29 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689326047383 (+68 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689326047497 (+114 ms) 2023-07-14 09:14:07,500 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-14 09:14:07,503 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 1.1790 sec 2023-07-14 09:14:08,440 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:14:08,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 09:14:08,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 09:14:08,489 DEBUG [Listener at jenkins-hbase9.apache.org/45395] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-14 09:14:08,493 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:51772, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-14 09:14:08,496 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37313] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-14 09:14:08,497 DEBUG [Listener at jenkins-hbase9.apache.org/45395] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-14 09:14:08,508 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:60010, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-14 09:14:08,508 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41875] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-14 09:14:08,509 DEBUG [Listener at jenkins-hbase9.apache.org/45395] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-14 09:14:08,512 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:39382, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-14 09:14:08,513 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45899] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-14 09:14:08,516 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-14 09:14:08,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:08,519 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 09:14:08,520 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-14 09:14:08,520 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 09:14:08,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-14 09:14:08,523 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e5b6d1880c4379ce1f1a8f82a2bb9c2a 2023-07-14 09:14:08,524 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e5b6d1880c4379ce1f1a8f82a2bb9c2a empty. 2023-07-14 09:14:08,525 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e5b6d1880c4379ce1f1a8f82a2bb9c2a 2023-07-14 09:14:08,526 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8ab511e94be57f277af83c9efb614771 2023-07-14 09:14:08,526 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8ab511e94be57f277af83c9efb614771 empty. 2023-07-14 09:14:08,527 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8ab511e94be57f277af83c9efb614771 2023-07-14 09:14:08,527 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-14 09:14:08,619 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-14 09:14:08,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-14 09:14:08,627 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => e5b6d1880c4379ce1f1a8f82a2bb9c2a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689326048515.e5b6d1880c4379ce1f1a8f82a2bb9c2a.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp 2023-07-14 09:14:08,627 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8ab511e94be57f277af83c9efb614771, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689326048515.8ab511e94be57f277af83c9efb614771.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp 2023-07-14 09:14:08,678 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689326048515.8ab511e94be57f277af83c9efb614771.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:14:08,678 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 8ab511e94be57f277af83c9efb614771, disabling compactions & flushes 2023-07-14 09:14:08,678 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689326048515.8ab511e94be57f277af83c9efb614771. 2023-07-14 09:14:08,679 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689326048515.8ab511e94be57f277af83c9efb614771. 2023-07-14 09:14:08,679 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689326048515.8ab511e94be57f277af83c9efb614771. after waiting 0 ms 2023-07-14 09:14:08,679 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689326048515.8ab511e94be57f277af83c9efb614771. 2023-07-14 09:14:08,679 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689326048515.8ab511e94be57f277af83c9efb614771. 2023-07-14 09:14:08,679 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 8ab511e94be57f277af83c9efb614771: 2023-07-14 09:14:08,693 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689326048515.e5b6d1880c4379ce1f1a8f82a2bb9c2a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:14:08,693 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing e5b6d1880c4379ce1f1a8f82a2bb9c2a, disabling compactions & flushes 2023-07-14 09:14:08,693 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689326048515.e5b6d1880c4379ce1f1a8f82a2bb9c2a. 2023-07-14 09:14:08,693 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689326048515.e5b6d1880c4379ce1f1a8f82a2bb9c2a. 2023-07-14 09:14:08,693 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689326048515.e5b6d1880c4379ce1f1a8f82a2bb9c2a. after waiting 0 ms 2023-07-14 09:14:08,693 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689326048515.e5b6d1880c4379ce1f1a8f82a2bb9c2a. 2023-07-14 09:14:08,693 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689326048515.e5b6d1880c4379ce1f1a8f82a2bb9c2a. 2023-07-14 09:14:08,693 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for e5b6d1880c4379ce1f1a8f82a2bb9c2a: 2023-07-14 09:14:08,696 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 09:14:08,697 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689326048515.8ab511e94be57f277af83c9efb614771.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689326048697"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689326048697"}]},"ts":"1689326048697"} 2023-07-14 09:14:08,697 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689326048515.e5b6d1880c4379ce1f1a8f82a2bb9c2a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689326048697"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689326048697"}]},"ts":"1689326048697"} 2023-07-14 09:14:08,700 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 09:14:08,701 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 09:14:08,701 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689326048701"}]},"ts":"1689326048701"} 2023-07-14 09:14:08,703 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-14 09:14:08,707 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 09:14:08,708 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 09:14:08,708 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 09:14:08,708 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 09:14:08,708 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 09:14:08,709 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e5b6d1880c4379ce1f1a8f82a2bb9c2a, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8ab511e94be57f277af83c9efb614771, ASSIGN}] 2023-07-14 09:14:08,712 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8ab511e94be57f277af83c9efb614771, ASSIGN 2023-07-14 09:14:08,712 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e5b6d1880c4379ce1f1a8f82a2bb9c2a, ASSIGN 2023-07-14 09:14:08,713 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8ab511e94be57f277af83c9efb614771, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,41875,1689325950034; forceNewPlan=false, retain=false 2023-07-14 09:14:08,713 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e5b6d1880c4379ce1f1a8f82a2bb9c2a, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45899,1689325949913; forceNewPlan=false, retain=false 2023-07-14 09:14:08,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-14 09:14:08,863 INFO [jenkins-hbase9:41733] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 09:14:08,867 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=e5b6d1880c4379ce1f1a8f82a2bb9c2a, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:08,867 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=8ab511e94be57f277af83c9efb614771, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:08,867 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689326048515.e5b6d1880c4379ce1f1a8f82a2bb9c2a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689326048866"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689326048866"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689326048866"}]},"ts":"1689326048866"} 2023-07-14 09:14:08,867 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689326048515.8ab511e94be57f277af83c9efb614771.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689326048867"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689326048867"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689326048867"}]},"ts":"1689326048867"} 2023-07-14 09:14:08,869 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure e5b6d1880c4379ce1f1a8f82a2bb9c2a, server=jenkins-hbase9.apache.org,45899,1689325949913}] 2023-07-14 09:14:08,871 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 8ab511e94be57f277af83c9efb614771, server=jenkins-hbase9.apache.org,41875,1689325950034}] 2023-07-14 09:14:09,026 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689326048515.e5b6d1880c4379ce1f1a8f82a2bb9c2a. 2023-07-14 09:14:09,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e5b6d1880c4379ce1f1a8f82a2bb9c2a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689326048515.e5b6d1880c4379ce1f1a8f82a2bb9c2a.', STARTKEY => '', ENDKEY => '2'} 2023-07-14 09:14:09,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689326048515.e5b6d1880c4379ce1f1a8f82a2bb9c2a. service=AccessControlService 2023-07-14 09:14:09,028 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 09:14:09,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 e5b6d1880c4379ce1f1a8f82a2bb9c2a 2023-07-14 09:14:09,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689326048515.e5b6d1880c4379ce1f1a8f82a2bb9c2a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:14:09,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for e5b6d1880c4379ce1f1a8f82a2bb9c2a 2023-07-14 09:14:09,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for e5b6d1880c4379ce1f1a8f82a2bb9c2a 2023-07-14 09:14:09,029 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689326048515.8ab511e94be57f277af83c9efb614771. 2023-07-14 09:14:09,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8ab511e94be57f277af83c9efb614771, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689326048515.8ab511e94be57f277af83c9efb614771.', STARTKEY => '2', ENDKEY => ''} 2023-07-14 09:14:09,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689326048515.8ab511e94be57f277af83c9efb614771. service=AccessControlService 2023-07-14 09:14:09,029 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 09:14:09,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 8ab511e94be57f277af83c9efb614771 2023-07-14 09:14:09,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689326048515.8ab511e94be57f277af83c9efb614771.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:14:09,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 8ab511e94be57f277af83c9efb614771 2023-07-14 09:14:09,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 8ab511e94be57f277af83c9efb614771 2023-07-14 09:14:09,035 INFO [StoreOpener-e5b6d1880c4379ce1f1a8f82a2bb9c2a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e5b6d1880c4379ce1f1a8f82a2bb9c2a 2023-07-14 09:14:09,036 INFO [StoreOpener-8ab511e94be57f277af83c9efb614771-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8ab511e94be57f277af83c9efb614771 2023-07-14 09:14:09,040 DEBUG [StoreOpener-e5b6d1880c4379ce1f1a8f82a2bb9c2a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e5b6d1880c4379ce1f1a8f82a2bb9c2a/cf 2023-07-14 09:14:09,040 DEBUG [StoreOpener-e5b6d1880c4379ce1f1a8f82a2bb9c2a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e5b6d1880c4379ce1f1a8f82a2bb9c2a/cf 2023-07-14 09:14:09,040 DEBUG [StoreOpener-8ab511e94be57f277af83c9efb614771-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8ab511e94be57f277af83c9efb614771/cf 2023-07-14 09:14:09,040 DEBUG [StoreOpener-8ab511e94be57f277af83c9efb614771-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8ab511e94be57f277af83c9efb614771/cf 2023-07-14 09:14:09,040 INFO [StoreOpener-e5b6d1880c4379ce1f1a8f82a2bb9c2a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e5b6d1880c4379ce1f1a8f82a2bb9c2a columnFamilyName cf 2023-07-14 09:14:09,040 INFO [StoreOpener-8ab511e94be57f277af83c9efb614771-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8ab511e94be57f277af83c9efb614771 columnFamilyName cf 2023-07-14 09:14:09,041 INFO [StoreOpener-e5b6d1880c4379ce1f1a8f82a2bb9c2a-1] regionserver.HStore(310): Store=e5b6d1880c4379ce1f1a8f82a2bb9c2a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 09:14:09,041 INFO [StoreOpener-8ab511e94be57f277af83c9efb614771-1] regionserver.HStore(310): Store=8ab511e94be57f277af83c9efb614771/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 09:14:09,042 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e5b6d1880c4379ce1f1a8f82a2bb9c2a 2023-07-14 09:14:09,042 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8ab511e94be57f277af83c9efb614771 2023-07-14 09:14:09,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8ab511e94be57f277af83c9efb614771 2023-07-14 09:14:09,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e5b6d1880c4379ce1f1a8f82a2bb9c2a 2023-07-14 09:14:09,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 8ab511e94be57f277af83c9efb614771 2023-07-14 09:14:09,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for e5b6d1880c4379ce1f1a8f82a2bb9c2a 2023-07-14 09:14:09,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e5b6d1880c4379ce1f1a8f82a2bb9c2a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 09:14:09,065 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened e5b6d1880c4379ce1f1a8f82a2bb9c2a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64977540, jitterRate=-0.03175920248031616}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 09:14:09,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8ab511e94be57f277af83c9efb614771/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 09:14:09,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for e5b6d1880c4379ce1f1a8f82a2bb9c2a: 2023-07-14 09:14:09,066 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 8ab511e94be57f277af83c9efb614771; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62351361, jitterRate=-0.0708923190832138}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 09:14:09,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 8ab511e94be57f277af83c9efb614771: 2023-07-14 09:14:09,067 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689326048515.8ab511e94be57f277af83c9efb614771., pid=70, masterSystemTime=1689326049023 2023-07-14 09:14:09,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689326048515.8ab511e94be57f277af83c9efb614771. 2023-07-14 09:14:09,069 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689326048515.8ab511e94be57f277af83c9efb614771. 2023-07-14 09:14:09,069 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=8ab511e94be57f277af83c9efb614771, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:09,070 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689326048515.8ab511e94be57f277af83c9efb614771.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689326049069"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689326049069"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689326049069"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689326049069"}]},"ts":"1689326049069"} 2023-07-14 09:14:09,070 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689326048515.e5b6d1880c4379ce1f1a8f82a2bb9c2a., pid=69, masterSystemTime=1689326049022 2023-07-14 09:14:09,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689326048515.e5b6d1880c4379ce1f1a8f82a2bb9c2a. 2023-07-14 09:14:09,073 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689326048515.e5b6d1880c4379ce1f1a8f82a2bb9c2a. 2023-07-14 09:14:09,078 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=e5b6d1880c4379ce1f1a8f82a2bb9c2a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:09,078 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689326048515.e5b6d1880c4379ce1f1a8f82a2bb9c2a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689326049078"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689326049078"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689326049078"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689326049078"}]},"ts":"1689326049078"} 2023-07-14 09:14:09,085 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-14 09:14:09,085 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 8ab511e94be57f277af83c9efb614771, server=jenkins-hbase9.apache.org,41875,1689325950034 in 201 msec 2023-07-14 09:14:09,088 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8ab511e94be57f277af83c9efb614771, ASSIGN in 376 msec 2023-07-14 09:14:09,090 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-14 09:14:09,090 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure e5b6d1880c4379ce1f1a8f82a2bb9c2a, server=jenkins-hbase9.apache.org,45899,1689325949913 in 218 msec 2023-07-14 09:14:09,095 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-14 09:14:09,095 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e5b6d1880c4379ce1f1a8f82a2bb9c2a, ASSIGN in 381 msec 2023-07-14 09:14:09,096 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 09:14:09,096 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689326049096"}]},"ts":"1689326049096"} 2023-07-14 09:14:09,098 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-14 09:14:09,101 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 09:14:09,102 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-14 09:14:09,104 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41875] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-14 09:14:09,106 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:09,106 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:09,106 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:09,107 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:09,110 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 09:14:09,110 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-14 09:14:09,110 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 09:14:09,110 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-14 09:14:09,110 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 09:14:09,111 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-14 09:14:09,111 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 09:14:09,111 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-14 09:14:09,114 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 594 msec 2023-07-14 09:14:09,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-14 09:14:09,129 INFO [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-14 09:14:09,146 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960675_0004_000001 (auth:SIMPLE) 2023-07-14 09:14:09,210 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] master.HMaster$2(1952): Client=jenkins//172.31.2.10 merge regions e5b6d1880c4379ce1f1a8f82a2bb9c2a, 8ab511e94be57f277af83c9efb614771 2023-07-14 09:14:09,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41733] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[e5b6d1880c4379ce1f1a8f82a2bb9c2a, 8ab511e94be57f277af83c9efb614771], force=true 2023-07-14 09:14:09,228 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[e5b6d1880c4379ce1f1a8f82a2bb9c2a, 8ab511e94be57f277af83c9efb614771], force=true 2023-07-14 09:14:09,228 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[e5b6d1880c4379ce1f1a8f82a2bb9c2a, 8ab511e94be57f277af83c9efb614771], force=true 2023-07-14 09:14:09,229 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[e5b6d1880c4379ce1f1a8f82a2bb9c2a, 8ab511e94be57f277af83c9efb614771], force=true 2023-07-14 09:14:09,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-14 09:14:09,263 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e5b6d1880c4379ce1f1a8f82a2bb9c2a, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8ab511e94be57f277af83c9efb614771, UNASSIGN}] 2023-07-14 09:14:09,267 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e5b6d1880c4379ce1f1a8f82a2bb9c2a, UNASSIGN 2023-07-14 09:14:09,267 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8ab511e94be57f277af83c9efb614771, UNASSIGN 2023-07-14 09:14:09,268 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=e5b6d1880c4379ce1f1a8f82a2bb9c2a, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:09,268 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689326048515.e5b6d1880c4379ce1f1a8f82a2bb9c2a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689326049268"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689326049268"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689326049268"}]},"ts":"1689326049268"} 2023-07-14 09:14:09,269 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=8ab511e94be57f277af83c9efb614771, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:09,269 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689326048515.8ab511e94be57f277af83c9efb614771.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689326049269"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689326049269"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689326049269"}]},"ts":"1689326049269"} 2023-07-14 09:14:09,271 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure e5b6d1880c4379ce1f1a8f82a2bb9c2a, server=jenkins-hbase9.apache.org,45899,1689325949913}] 2023-07-14 09:14:09,271 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 8ab511e94be57f277af83c9efb614771, server=jenkins-hbase9.apache.org,41875,1689325950034}] 2023-07-14 09:14:09,289 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-14 09:14:09,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-14 09:14:09,426 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close e5b6d1880c4379ce1f1a8f82a2bb9c2a 2023-07-14 09:14:09,429 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 8ab511e94be57f277af83c9efb614771 2023-07-14 09:14:09,447 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing e5b6d1880c4379ce1f1a8f82a2bb9c2a, disabling compactions & flushes 2023-07-14 09:14:09,449 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689326048515.e5b6d1880c4379ce1f1a8f82a2bb9c2a. 2023-07-14 09:14:09,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689326048515.e5b6d1880c4379ce1f1a8f82a2bb9c2a. 2023-07-14 09:14:09,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689326048515.e5b6d1880c4379ce1f1a8f82a2bb9c2a. after waiting 0 ms 2023-07-14 09:14:09,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689326048515.e5b6d1880c4379ce1f1a8f82a2bb9c2a. 2023-07-14 09:14:09,449 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing e5b6d1880c4379ce1f1a8f82a2bb9c2a 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-14 09:14:09,450 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 8ab511e94be57f277af83c9efb614771, disabling compactions & flushes 2023-07-14 09:14:09,450 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689326048515.8ab511e94be57f277af83c9efb614771. 2023-07-14 09:14:09,450 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689326048515.8ab511e94be57f277af83c9efb614771. 2023-07-14 09:14:09,450 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689326048515.8ab511e94be57f277af83c9efb614771. after waiting 0 ms 2023-07-14 09:14:09,450 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689326048515.8ab511e94be57f277af83c9efb614771. 2023-07-14 09:14:09,450 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 8ab511e94be57f277af83c9efb614771 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-14 09:14:09,524 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e5b6d1880c4379ce1f1a8f82a2bb9c2a/.tmp/cf/d83ae0dd83cc45bcbfaa644fae64a637 2023-07-14 09:14:09,530 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8ab511e94be57f277af83c9efb614771/.tmp/cf/309ed230130e430b96a5bb405427b43e 2023-07-14 09:14:09,535 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e5b6d1880c4379ce1f1a8f82a2bb9c2a/.tmp/cf/d83ae0dd83cc45bcbfaa644fae64a637 as hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e5b6d1880c4379ce1f1a8f82a2bb9c2a/cf/d83ae0dd83cc45bcbfaa644fae64a637 2023-07-14 09:14:09,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-14 09:14:09,543 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e5b6d1880c4379ce1f1a8f82a2bb9c2a/cf/d83ae0dd83cc45bcbfaa644fae64a637, entries=1, sequenceid=5, filesize=4.7 K 2023-07-14 09:14:09,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8ab511e94be57f277af83c9efb614771/.tmp/cf/309ed230130e430b96a5bb405427b43e as hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8ab511e94be57f277af83c9efb614771/cf/309ed230130e430b96a5bb405427b43e 2023-07-14 09:14:09,546 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for e5b6d1880c4379ce1f1a8f82a2bb9c2a in 97ms, sequenceid=5, compaction requested=false 2023-07-14 09:14:09,574 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8ab511e94be57f277af83c9efb614771/cf/309ed230130e430b96a5bb405427b43e, entries=1, sequenceid=5, filesize=4.7 K 2023-07-14 09:14:09,575 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 8ab511e94be57f277af83c9efb614771 in 125ms, sequenceid=5, compaction requested=false 2023-07-14 09:14:09,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e5b6d1880c4379ce1f1a8f82a2bb9c2a/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-14 09:14:09,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 09:14:09,658 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689326048515.e5b6d1880c4379ce1f1a8f82a2bb9c2a. 2023-07-14 09:14:09,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for e5b6d1880c4379ce1f1a8f82a2bb9c2a: 2023-07-14 09:14:09,661 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed e5b6d1880c4379ce1f1a8f82a2bb9c2a 2023-07-14 09:14:09,671 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=e5b6d1880c4379ce1f1a8f82a2bb9c2a, regionState=CLOSED 2023-07-14 09:14:09,671 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689326048515.e5b6d1880c4379ce1f1a8f82a2bb9c2a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689326049671"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689326049671"}]},"ts":"1689326049671"} 2023-07-14 09:14:09,677 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-14 09:14:09,677 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure e5b6d1880c4379ce1f1a8f82a2bb9c2a, server=jenkins-hbase9.apache.org,45899,1689325949913 in 404 msec 2023-07-14 09:14:09,679 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e5b6d1880c4379ce1f1a8f82a2bb9c2a, UNASSIGN in 418 msec 2023-07-14 09:14:09,687 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8ab511e94be57f277af83c9efb614771/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-14 09:14:09,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 09:14:09,693 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689326048515.8ab511e94be57f277af83c9efb614771. 2023-07-14 09:14:09,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 8ab511e94be57f277af83c9efb614771: 2023-07-14 09:14:09,697 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 8ab511e94be57f277af83c9efb614771 2023-07-14 09:14:09,698 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=8ab511e94be57f277af83c9efb614771, regionState=CLOSED 2023-07-14 09:14:09,698 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689326048515.8ab511e94be57f277af83c9efb614771.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689326049698"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689326049698"}]},"ts":"1689326049698"} 2023-07-14 09:14:09,704 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-14 09:14:09,704 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 8ab511e94be57f277af83c9efb614771, server=jenkins-hbase9.apache.org,41875,1689325950034 in 430 msec 2023-07-14 09:14:09,708 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=71 2023-07-14 09:14:09,708 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8ab511e94be57f277af83c9efb614771, UNASSIGN in 441 msec 2023-07-14 09:14:09,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-14 09:14:09,932 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3e8b1e024144080fa0f11d41fc750ff8/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-14 09:14:09,936 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689326048515.e5b6d1880c4379ce1f1a8f82a2bb9c2a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-14 09:14:09,936 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689326048515.8ab511e94be57f277af83c9efb614771.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-14 09:14:09,936 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689326048516.3e8b1e024144080fa0f11d41fc750ff8.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-14 09:14:10,061 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3e8b1e024144080fa0f11d41fc750ff8, ASSIGN}] 2023-07-14 09:14:10,066 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3e8b1e024144080fa0f11d41fc750ff8, ASSIGN 2023-07-14 09:14:10,068 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3e8b1e024144080fa0f11d41fc750ff8, ASSIGN; state=MERGED, location=jenkins-hbase9.apache.org,45899,1689325949913; forceNewPlan=false, retain=false 2023-07-14 09:14:10,219 INFO [jenkins-hbase9:41733] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-14 09:14:10,221 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=3e8b1e024144080fa0f11d41fc750ff8, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:10,221 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689326048516.3e8b1e024144080fa0f11d41fc750ff8.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689326050221"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689326050221"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689326050221"}]},"ts":"1689326050221"} 2023-07-14 09:14:10,222 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 09:14:10,224 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 3e8b1e024144080fa0f11d41fc750ff8, server=jenkins-hbase9.apache.org,45899,1689325949913}] 2023-07-14 09:14:10,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-14 09:14:10,384 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689326048516.3e8b1e024144080fa0f11d41fc750ff8. 2023-07-14 09:14:10,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3e8b1e024144080fa0f11d41fc750ff8, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689326048516.3e8b1e024144080fa0f11d41fc750ff8.', STARTKEY => '', ENDKEY => ''} 2023-07-14 09:14:10,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689326048516.3e8b1e024144080fa0f11d41fc750ff8. service=AccessControlService 2023-07-14 09:14:10,385 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 09:14:10,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 3e8b1e024144080fa0f11d41fc750ff8 2023-07-14 09:14:10,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689326048516.3e8b1e024144080fa0f11d41fc750ff8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:14:10,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 3e8b1e024144080fa0f11d41fc750ff8 2023-07-14 09:14:10,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 3e8b1e024144080fa0f11d41fc750ff8 2023-07-14 09:14:10,387 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3e8b1e024144080fa0f11d41fc750ff8/.regioninfo 2023-07-14 09:14:10,483 INFO [StoreOpener-3e8b1e024144080fa0f11d41fc750ff8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3e8b1e024144080fa0f11d41fc750ff8 2023-07-14 09:14:10,484 DEBUG [StoreOpener-3e8b1e024144080fa0f11d41fc750ff8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3e8b1e024144080fa0f11d41fc750ff8/cf 2023-07-14 09:14:10,484 DEBUG [StoreOpener-3e8b1e024144080fa0f11d41fc750ff8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3e8b1e024144080fa0f11d41fc750ff8/cf 2023-07-14 09:14:10,485 INFO [StoreOpener-3e8b1e024144080fa0f11d41fc750ff8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3e8b1e024144080fa0f11d41fc750ff8 columnFamilyName cf 2023-07-14 09:14:10,529 DEBUG [StoreOpener-3e8b1e024144080fa0f11d41fc750ff8-1] regionserver.HStore(539): loaded hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3e8b1e024144080fa0f11d41fc750ff8/cf/309ed230130e430b96a5bb405427b43e.8ab511e94be57f277af83c9efb614771->hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8ab511e94be57f277af83c9efb614771/cf/309ed230130e430b96a5bb405427b43e-top 2023-07-14 09:14:10,541 DEBUG [StoreOpener-3e8b1e024144080fa0f11d41fc750ff8-1] regionserver.HStore(539): loaded hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3e8b1e024144080fa0f11d41fc750ff8/cf/d83ae0dd83cc45bcbfaa644fae64a637.e5b6d1880c4379ce1f1a8f82a2bb9c2a->hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e5b6d1880c4379ce1f1a8f82a2bb9c2a/cf/d83ae0dd83cc45bcbfaa644fae64a637-top 2023-07-14 09:14:10,543 INFO [StoreOpener-3e8b1e024144080fa0f11d41fc750ff8-1] regionserver.HStore(310): Store=3e8b1e024144080fa0f11d41fc750ff8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 09:14:10,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3e8b1e024144080fa0f11d41fc750ff8 2023-07-14 09:14:10,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3e8b1e024144080fa0f11d41fc750ff8 2023-07-14 09:14:10,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 3e8b1e024144080fa0f11d41fc750ff8 2023-07-14 09:14:10,551 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 3e8b1e024144080fa0f11d41fc750ff8; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71149206, jitterRate=0.06020578742027283}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 09:14:10,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 3e8b1e024144080fa0f11d41fc750ff8: 2023-07-14 09:14:10,557 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689326048516.3e8b1e024144080fa0f11d41fc750ff8., pid=77, masterSystemTime=1689326050380 2023-07-14 09:14:10,558 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689326048516.3e8b1e024144080fa0f11d41fc750ff8.,because compaction is disabled. 2023-07-14 09:14:10,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689326048516.3e8b1e024144080fa0f11d41fc750ff8. 2023-07-14 09:14:10,561 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689326048516.3e8b1e024144080fa0f11d41fc750ff8. 2023-07-14 09:14:10,562 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=3e8b1e024144080fa0f11d41fc750ff8, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:10,562 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689326048516.3e8b1e024144080fa0f11d41fc750ff8.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689326050562"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689326050562"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689326050562"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689326050562"}]},"ts":"1689326050562"} 2023-07-14 09:14:10,568 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-14 09:14:10,568 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 3e8b1e024144080fa0f11d41fc750ff8, server=jenkins-hbase9.apache.org,45899,1689325949913 in 341 msec 2023-07-14 09:14:10,570 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-14 09:14:10,570 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3e8b1e024144080fa0f11d41fc750ff8, ASSIGN in 507 msec 2023-07-14 09:14:10,572 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[e5b6d1880c4379ce1f1a8f82a2bb9c2a, 8ab511e94be57f277af83c9efb614771], force=true in 1.3550 sec 2023-07-14 09:14:11,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-14 09:14:11,342 INFO [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-14 09:14:11,343 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-14 09:14:11,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689326051344 (current time:1689326051344). 2023-07-14 09:14:11,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 09:14:11,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] zookeeper.ReadOnlyZKClient(139): Connect 0x4cf747fd to 127.0.0.1:59920 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:14:11,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4230b013, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:14:11,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:14:11,400 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:36786, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:14:11,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4cf747fd to 127.0.0.1:59920 2023-07-14 09:14:11,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:14:11,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] zookeeper.ReadOnlyZKClient(139): Connect 0x030dba28 to 127.0.0.1:59920 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:14:11,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7533cd1b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:14:11,449 DEBUG [hconnection-0x32c45b86-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:14:11,457 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:36796, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:14:11,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:14:11,476 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:35850, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:14:11,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x030dba28 to 127.0.0.1:59920 2023-07-14 09:14:11,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:14:11,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-14 09:14:11,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 09:14:11,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-14 09:14:11,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-14 09:14:11,483 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-14 09:14:11,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-14 09:14:11,485 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,486 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689326651485 2023-07-14 09:14:11,486 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 09:14:11,490 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 09:14:11,492 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-14 09:14:11,492 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-14 09:14:11,494 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 12 msec 2023-07-14 09:14:11,495 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-14 09:14:11,496 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689326651496 2023-07-14 09:14:11,586 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,586 INFO [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-14 09:14:11,586 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:11,588 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-14 09:14:11,588 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-14 09:14:11,589 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,589 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,590 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:11,590 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:11,590 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:11,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:11,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:11,590 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:11,590 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:14:11,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:11,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:11,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:11,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:11,591 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:11,592 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 09:14:11,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,592 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-14 09:14:11,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:14:11,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-14 09:14:11,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,592 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 09:14:11,593 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-14 09:14:11,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,596 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-14 09:14:11,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,596 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,597 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-14 09:14:11,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-14 09:14:11,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,598 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-14 09:14:11,601 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,601 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-14 09:14:11,601 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:11,615 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,616 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-14 09:14:11,616 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:11,616 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,616 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-14 09:14:11,619 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:11,618 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-14 09:14:11,619 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-14 09:14:11,618 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-14 09:14:11,619 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-14 09:14:11,619 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45899,1689325949913' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-14 09:14:11,619 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41875,1689325950034' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-14 09:14:11,622 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,622 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:11,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:11,622 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,622 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:14:11,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:11,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:11,625 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-14 09:14:11,625 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-14 09:14:11,625 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,37313,1689325949765' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-14 09:14:11,626 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:11,627 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,627 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:14:11,628 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,628 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,629 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:14:11,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:11,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:11,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:11,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:11,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:11,632 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45899,1689325949913' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-14 09:14:11,632 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b8d6a9a[Count = 0] remaining members to acquire global barrier 2023-07-14 09:14:11,632 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-14 09:14:11,632 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,634 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,634 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,634 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,634 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-14 09:14:11,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,634 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:11,634 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 09:14:11,634 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-14 09:14:11,634 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase9.apache.org,37313,1689325949765' in zk 2023-07-14 09:14:11,634 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-14 09:14:11,634 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-14 09:14:11,635 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-14 09:14:11,635 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase9.apache.org,41875,1689325950034' in zk 2023-07-14 09:14:11,638 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-14 09:14:11,638 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:11,638 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-14 09:14:11,640 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-14 09:14:11,640 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:11,640 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-14 09:14:11,652 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 09:14:11,652 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689326048516.3e8b1e024144080fa0f11d41fc750ff8. 2023-07-14 09:14:11,652 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 09:14:11,652 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689326048516.3e8b1e024144080fa0f11d41fc750ff8. started... 2023-07-14 09:14:11,655 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3e8b1e024144080fa0f11d41fc750ff8: 2023-07-14 09:14:11,655 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689326048516.3e8b1e024144080fa0f11d41fc750ff8.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,655 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 09:14:11,655 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3e8b1e024144080fa0f11d41fc750ff8/cf/309ed230130e430b96a5bb405427b43e.8ab511e94be57f277af83c9efb614771->hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8ab511e94be57f277af83c9efb614771/cf/309ed230130e430b96a5bb405427b43e-top, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3e8b1e024144080fa0f11d41fc750ff8/cf/d83ae0dd83cc45bcbfaa644fae64a637.e5b6d1880c4379ce1f1a8f82a2bb9c2a->hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e5b6d1880c4379ce1f1a8f82a2bb9c2a/cf/d83ae0dd83cc45bcbfaa644fae64a637-top] hfiles 2023-07-14 09:14:11,655 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3e8b1e024144080fa0f11d41fc750ff8/cf/309ed230130e430b96a5bb405427b43e.8ab511e94be57f277af83c9efb614771 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,656 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3e8b1e024144080fa0f11d41fc750ff8/cf/d83ae0dd83cc45bcbfaa644fae64a637.e5b6d1880c4379ce1f1a8f82a2bb9c2a for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,700 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689326048516.3e8b1e024144080fa0f11d41fc750ff8. completed. 2023-07-14 09:14:11,701 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689326048516.3e8b1e024144080fa0f11d41fc750ff8. 2023-07-14 09:14:11,701 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 09:14:11,701 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 09:14:11,701 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:11,701 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-14 09:14:11,701 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase9.apache.org,45899,1689325949913' in zk 2023-07-14 09:14:11,707 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:11,708 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-14 09:14:11,708 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:11,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:11,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:11,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:11,708 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-14 09:14:11,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:11,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:11,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:11,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:11,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:11,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:11,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:11,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:11,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:11,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase9.apache.org,45899,1689325949913': 2023-07-14 09:14:11,712 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45899,1689325949913' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-14 09:14:11,712 INFO [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-14 09:14:11,712 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 09:14:11,712 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 09:14:11,712 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,712 INFO [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 09:14:11,714 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,714 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,714 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,714 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:11,714 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,714 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:11,714 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:11,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:11,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:11,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:11,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:11,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:11,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:11,715 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:11,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:11,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:11,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,716 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:11,717 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:11,720 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:11,721 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:11,721 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:11,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:11,725 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:11,725 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:11,725 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:11,725 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:11,725 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:11,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:11,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:11,725 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,725 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:11,725 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:11,725 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,725 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:11,725 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,725 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:11,725 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:11,726 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,726 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:11,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:11,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:11,725 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:11,725 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,726 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,726 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:11,726 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:11,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:11,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:11,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:11,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:11,727 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:11,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:11,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:11,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:11,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:11,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:11,738 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 because node does not exist (not an error) 2023-07-14 09:14:11,793 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:14:11,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-14 09:14:11,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:14:11,794 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 09:14:11,803 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:12,094 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:14:12,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-14 09:14:12,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:14:12,096 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-14 09:14:12,373 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-14 09:14:12,373 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:12,374 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:12,374 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689326051486Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689326051726 (+240 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689326051726Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689326051740 (+14 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689326051778 (+38 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689326052373 (+595 ms) 2023-07-14 09:14:12,377 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-14 09:14:12,380 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 887 msec 2023-07-14 09:14:12,597 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:14:12,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-14 09:14:12,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 09:14:12,598 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/export-test/export-1689326052598 2023-07-14 09:14:12,598 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43771, tgtDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/export-test/export-1689326052598, rawTgtDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/export-test/export-1689326052598, srcFsUri=hdfs://localhost:43771, srcDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8 2023-07-14 09:14:12,665 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43771, inputRoot=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8 2023-07-14 09:14:12,666 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1457635613_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/export-test/export-1689326052598, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/export-test/export-1689326052598/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:12,666 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43771, inputRoot=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8, snapshotDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-14 09:14:12,679 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/export-test/export-1689326052598/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:12,770 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:12,771 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:12,771 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:12,771 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:12,771 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:12,772 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:12,772 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:12,902 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/hadoop-8750097449415046918.jar 2023-07-14 09:14:12,902 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:12,903 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:12,903 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:12,904 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:12,904 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:12,908 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:12,908 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 09:14:12,909 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 09:14:12,910 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 09:14:12,911 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 09:14:12,912 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 09:14:12,913 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 09:14:12,913 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 09:14:12,914 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 09:14:12,914 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 09:14:12,915 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 09:14:12,916 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:14:12,916 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:14:12,917 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 09:14:12,917 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:14:12,917 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:14:12,918 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 09:14:12,919 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 09:14:14,254 WARN [Listener at jenkins-hbase9.apache.org/45395] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 09:14:14,259 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-14 09:14:14,261 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-14 09:14:14,771 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 09:14:14,772 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 09:14:15,145 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960675_0005_000001 (auth:SIMPLE) 2023-07-14 09:14:15,155 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 09:14:23,710 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960675_0005_000001 (auth:SIMPLE) 2023-07-14 09:14:26,304 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960675_0005_000001 (auth:SIMPLE) 2023-07-14 09:14:33,204 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 09:14:33,204 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 09:14:33,216 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:33,216 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 09:14:33,217 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 09:14:33,217 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2112291524_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:33,217 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(367): hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-14 09:14:33,218 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(367): hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-14 09:14:33,218 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2112291524_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/export-test/export-1689326052598/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/export-test/export-1689326052598/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:33,218 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(367): hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/export-test/export-1689326052598/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-14 09:14:33,218 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(367): hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/export-test/export-1689326052598/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-14 09:14:33,225 INFO [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:33,226 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:33,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:33,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-14 09:14:33,236 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689326073236"}]},"ts":"1689326073236"} 2023-07-14 09:14:33,240 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-14 09:14:33,244 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-14 09:14:33,245 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3e8b1e024144080fa0f11d41fc750ff8, UNASSIGN}] 2023-07-14 09:14:33,246 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3e8b1e024144080fa0f11d41fc750ff8, UNASSIGN 2023-07-14 09:14:33,247 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=3e8b1e024144080fa0f11d41fc750ff8, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:33,247 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689326048516.3e8b1e024144080fa0f11d41fc750ff8.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689326073247"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689326073247"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689326073247"}]},"ts":"1689326073247"} 2023-07-14 09:14:33,250 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 3e8b1e024144080fa0f11d41fc750ff8, server=jenkins-hbase9.apache.org,45899,1689325949913}] 2023-07-14 09:14:33,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-14 09:14:33,405 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 3e8b1e024144080fa0f11d41fc750ff8 2023-07-14 09:14:33,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 3e8b1e024144080fa0f11d41fc750ff8, disabling compactions & flushes 2023-07-14 09:14:33,405 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689326048516.3e8b1e024144080fa0f11d41fc750ff8. 2023-07-14 09:14:33,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689326048516.3e8b1e024144080fa0f11d41fc750ff8. 2023-07-14 09:14:33,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689326048516.3e8b1e024144080fa0f11d41fc750ff8. after waiting 0 ms 2023-07-14 09:14:33,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689326048516.3e8b1e024144080fa0f11d41fc750ff8. 2023-07-14 09:14:33,427 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3e8b1e024144080fa0f11d41fc750ff8/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-14 09:14:33,428 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 09:14:33,429 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689326048516.3e8b1e024144080fa0f11d41fc750ff8. 2023-07-14 09:14:33,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 3e8b1e024144080fa0f11d41fc750ff8: 2023-07-14 09:14:33,436 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 3e8b1e024144080fa0f11d41fc750ff8 2023-07-14 09:14:33,436 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=3e8b1e024144080fa0f11d41fc750ff8, regionState=CLOSED 2023-07-14 09:14:33,437 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689326048516.3e8b1e024144080fa0f11d41fc750ff8.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689326073436"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689326073436"}]},"ts":"1689326073436"} 2023-07-14 09:14:33,440 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-14 09:14:33,440 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 3e8b1e024144080fa0f11d41fc750ff8, server=jenkins-hbase9.apache.org,45899,1689325949913 in 188 msec 2023-07-14 09:14:33,442 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-14 09:14:33,442 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3e8b1e024144080fa0f11d41fc750ff8, UNASSIGN in 195 msec 2023-07-14 09:14:33,442 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689326073442"}]},"ts":"1689326073442"} 2023-07-14 09:14:33,444 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-14 09:14:33,447 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-14 09:14:33,451 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 222 msec 2023-07-14 09:14:33,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-14 09:14:33,540 INFO [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-14 09:14:33,540 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:33,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:33,545 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:33,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:33,546 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:33,548 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41875] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:33,551 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:33,551 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:33,551 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-14 09:14:33,551 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3e8b1e024144080fa0f11d41fc750ff8 2023-07-14 09:14:33,551 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8ab511e94be57f277af83c9efb614771 2023-07-14 09:14:33,551 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e5b6d1880c4379ce1f1a8f82a2bb9c2a 2023-07-14 09:14:33,552 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:33,552 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:33,552 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:33,552 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:33,552 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:33,552 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-14 09:14:33,552 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-14 09:14:33,552 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:33,552 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:33,553 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-14 09:14:33,553 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-14 09:14:33,553 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-14 09:14:33,553 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-14 09:14:33,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-14 09:14:33,553 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 09:14:33,553 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 09:14:33,554 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 09:14:33,554 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 09:14:33,555 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8ab511e94be57f277af83c9efb614771/cf, FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8ab511e94be57f277af83c9efb614771/recovered.edits] 2023-07-14 09:14:33,555 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3e8b1e024144080fa0f11d41fc750ff8/cf, FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3e8b1e024144080fa0f11d41fc750ff8/recovered.edits] 2023-07-14 09:14:33,556 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e5b6d1880c4379ce1f1a8f82a2bb9c2a/cf, FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e5b6d1880c4379ce1f1a8f82a2bb9c2a/recovered.edits] 2023-07-14 09:14:33,561 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3e8b1e024144080fa0f11d41fc750ff8/cf/309ed230130e430b96a5bb405427b43e.8ab511e94be57f277af83c9efb614771 to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3e8b1e024144080fa0f11d41fc750ff8/cf/309ed230130e430b96a5bb405427b43e.8ab511e94be57f277af83c9efb614771 2023-07-14 09:14:33,562 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8ab511e94be57f277af83c9efb614771/cf/309ed230130e430b96a5bb405427b43e to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8ab511e94be57f277af83c9efb614771/cf/309ed230130e430b96a5bb405427b43e 2023-07-14 09:14:33,563 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e5b6d1880c4379ce1f1a8f82a2bb9c2a/cf/d83ae0dd83cc45bcbfaa644fae64a637 to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e5b6d1880c4379ce1f1a8f82a2bb9c2a/cf/d83ae0dd83cc45bcbfaa644fae64a637 2023-07-14 09:14:33,563 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3e8b1e024144080fa0f11d41fc750ff8/cf/d83ae0dd83cc45bcbfaa644fae64a637.e5b6d1880c4379ce1f1a8f82a2bb9c2a to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3e8b1e024144080fa0f11d41fc750ff8/cf/d83ae0dd83cc45bcbfaa644fae64a637.e5b6d1880c4379ce1f1a8f82a2bb9c2a 2023-07-14 09:14:33,566 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8ab511e94be57f277af83c9efb614771/recovered.edits/8.seqid to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8ab511e94be57f277af83c9efb614771/recovered.edits/8.seqid 2023-07-14 09:14:33,567 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e5b6d1880c4379ce1f1a8f82a2bb9c2a/recovered.edits/8.seqid to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e5b6d1880c4379ce1f1a8f82a2bb9c2a/recovered.edits/8.seqid 2023-07-14 09:14:33,567 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8ab511e94be57f277af83c9efb614771 2023-07-14 09:14:33,567 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3e8b1e024144080fa0f11d41fc750ff8/recovered.edits/12.seqid to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3e8b1e024144080fa0f11d41fc750ff8/recovered.edits/12.seqid 2023-07-14 09:14:33,568 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e5b6d1880c4379ce1f1a8f82a2bb9c2a 2023-07-14 09:14:33,568 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3e8b1e024144080fa0f11d41fc750ff8 2023-07-14 09:14:33,568 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-14 09:14:33,574 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:33,576 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-14 09:14:33,578 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-14 09:14:33,580 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:33,580 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-14 09:14:33,580 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689326048516.3e8b1e024144080fa0f11d41fc750ff8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689326073580"}]},"ts":"9223372036854775807"} 2023-07-14 09:14:33,582 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-14 09:14:33,582 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3e8b1e024144080fa0f11d41fc750ff8, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689326048516.3e8b1e024144080fa0f11d41fc750ff8.', STARTKEY => '', ENDKEY => ''}] 2023-07-14 09:14:33,582 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-14 09:14:33,582 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689326073582"}]},"ts":"9223372036854775807"} 2023-07-14 09:14:33,587 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-14 09:14:33,590 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:33,591 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 49 msec 2023-07-14 09:14:33,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-14 09:14:33,655 INFO [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-14 09:14:33,656 INFO [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:33,657 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:33,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:33,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-14 09:14:33,662 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689326073662"}]},"ts":"1689326073662"} 2023-07-14 09:14:33,664 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-14 09:14:33,665 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-14 09:14:33,666 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=da15be0ffbf23d00411aeb89550b8a65, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d058974e29817d70d499efa41b4a43e5, UNASSIGN}] 2023-07-14 09:14:33,668 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=da15be0ffbf23d00411aeb89550b8a65, UNASSIGN 2023-07-14 09:14:33,668 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d058974e29817d70d499efa41b4a43e5, UNASSIGN 2023-07-14 09:14:33,669 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=da15be0ffbf23d00411aeb89550b8a65, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:33,670 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689326044872.da15be0ffbf23d00411aeb89550b8a65.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689326073669"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689326073669"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689326073669"}]},"ts":"1689326073669"} 2023-07-14 09:14:33,670 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=d058974e29817d70d499efa41b4a43e5, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:33,670 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689326044872.d058974e29817d70d499efa41b4a43e5.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689326073670"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689326073670"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689326073670"}]},"ts":"1689326073670"} 2023-07-14 09:14:33,674 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure da15be0ffbf23d00411aeb89550b8a65, server=jenkins-hbase9.apache.org,45899,1689325949913}] 2023-07-14 09:14:33,675 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure d058974e29817d70d499efa41b4a43e5, server=jenkins-hbase9.apache.org,41875,1689325950034}] 2023-07-14 09:14:33,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-14 09:14:33,826 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close da15be0ffbf23d00411aeb89550b8a65 2023-07-14 09:14:33,827 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing da15be0ffbf23d00411aeb89550b8a65, disabling compactions & flushes 2023-07-14 09:14:33,827 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689326044872.da15be0ffbf23d00411aeb89550b8a65. 2023-07-14 09:14:33,827 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689326044872.da15be0ffbf23d00411aeb89550b8a65. 2023-07-14 09:14:33,827 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689326044872.da15be0ffbf23d00411aeb89550b8a65. after waiting 0 ms 2023-07-14 09:14:33,827 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689326044872.da15be0ffbf23d00411aeb89550b8a65. 2023-07-14 09:14:33,827 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close d058974e29817d70d499efa41b4a43e5 2023-07-14 09:14:33,832 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing d058974e29817d70d499efa41b4a43e5, disabling compactions & flushes 2023-07-14 09:14:33,832 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689326044872.d058974e29817d70d499efa41b4a43e5. 2023-07-14 09:14:33,832 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689326044872.d058974e29817d70d499efa41b4a43e5. 2023-07-14 09:14:33,832 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689326044872.d058974e29817d70d499efa41b4a43e5. after waiting 0 ms 2023-07-14 09:14:33,832 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689326044872.d058974e29817d70d499efa41b4a43e5. 2023-07-14 09:14:33,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion/da15be0ffbf23d00411aeb89550b8a65/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 09:14:33,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithMergeRegion/d058974e29817d70d499efa41b4a43e5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 09:14:33,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 09:14:33,841 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689326044872.da15be0ffbf23d00411aeb89550b8a65. 2023-07-14 09:14:33,842 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for da15be0ffbf23d00411aeb89550b8a65: 2023-07-14 09:14:33,842 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 09:14:33,843 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689326044872.d058974e29817d70d499efa41b4a43e5. 2023-07-14 09:14:33,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for d058974e29817d70d499efa41b4a43e5: 2023-07-14 09:14:33,845 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed d058974e29817d70d499efa41b4a43e5 2023-07-14 09:14:33,845 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=d058974e29817d70d499efa41b4a43e5, regionState=CLOSED 2023-07-14 09:14:33,845 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689326044872.d058974e29817d70d499efa41b4a43e5.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689326073845"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689326073845"}]},"ts":"1689326073845"} 2023-07-14 09:14:33,846 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed da15be0ffbf23d00411aeb89550b8a65 2023-07-14 09:14:33,846 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=da15be0ffbf23d00411aeb89550b8a65, regionState=CLOSED 2023-07-14 09:14:33,846 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689326044872.da15be0ffbf23d00411aeb89550b8a65.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689326073846"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689326073846"}]},"ts":"1689326073846"} 2023-07-14 09:14:33,853 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-14 09:14:33,853 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure d058974e29817d70d499efa41b4a43e5, server=jenkins-hbase9.apache.org,41875,1689325950034 in 172 msec 2023-07-14 09:14:33,854 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-14 09:14:33,854 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure da15be0ffbf23d00411aeb89550b8a65, server=jenkins-hbase9.apache.org,45899,1689325949913 in 175 msec 2023-07-14 09:14:33,855 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d058974e29817d70d499efa41b4a43e5, UNASSIGN in 187 msec 2023-07-14 09:14:33,856 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-14 09:14:33,856 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=da15be0ffbf23d00411aeb89550b8a65, UNASSIGN in 188 msec 2023-07-14 09:14:33,856 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689326073856"}]},"ts":"1689326073856"} 2023-07-14 09:14:33,860 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-14 09:14:33,862 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-14 09:14:33,864 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 206 msec 2023-07-14 09:14:33,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-14 09:14:33,965 INFO [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-14 09:14:33,966 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:33,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:33,970 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:33,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:33,971 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:33,972 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41875] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:33,975 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:33,975 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:33,975 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:33,975 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:33,975 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-14 09:14:33,975 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-14 09:14:33,976 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-14 09:14:33,976 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-14 09:14:33,976 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/da15be0ffbf23d00411aeb89550b8a65 2023-07-14 09:14:33,976 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d058974e29817d70d499efa41b4a43e5 2023-07-14 09:14:33,977 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:33,977 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:33,979 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:33,979 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:33,979 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:33,979 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:33,979 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d058974e29817d70d499efa41b4a43e5/cf, FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d058974e29817d70d499efa41b4a43e5/recovered.edits] 2023-07-14 09:14:33,979 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:33,979 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:33,979 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/da15be0ffbf23d00411aeb89550b8a65/cf, FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/da15be0ffbf23d00411aeb89550b8a65/recovered.edits] 2023-07-14 09:14:33,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-14 09:14:33,984 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d058974e29817d70d499efa41b4a43e5/cf/6e86d5a0b1c948a99c204e21153c1ed6 to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/d058974e29817d70d499efa41b4a43e5/cf/6e86d5a0b1c948a99c204e21153c1ed6 2023-07-14 09:14:33,984 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/da15be0ffbf23d00411aeb89550b8a65/cf/d8b7b8582ef248e38020dc4ea4ddbd3a to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/da15be0ffbf23d00411aeb89550b8a65/cf/d8b7b8582ef248e38020dc4ea4ddbd3a 2023-07-14 09:14:33,988 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d058974e29817d70d499efa41b4a43e5/recovered.edits/9.seqid to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/d058974e29817d70d499efa41b4a43e5/recovered.edits/9.seqid 2023-07-14 09:14:33,988 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/da15be0ffbf23d00411aeb89550b8a65/recovered.edits/9.seqid to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/da15be0ffbf23d00411aeb89550b8a65/recovered.edits/9.seqid 2023-07-14 09:14:33,989 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d058974e29817d70d499efa41b4a43e5 2023-07-14 09:14:33,989 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/da15be0ffbf23d00411aeb89550b8a65 2023-07-14 09:14:33,989 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-14 09:14:33,990 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-14 09:14:33,991 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-14 09:14:33,995 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230714a5f18789eff74a9d8732c63a084e3566 to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230714a5f18789eff74a9d8732c63a084e3566 2023-07-14 09:14:33,996 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023071422ecf2cfb86c4d13a4727cad3fac483d to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023071422ecf2cfb86c4d13a4727cad3fac483d 2023-07-14 09:14:33,997 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-14 09:14:33,999 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:34,002 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-14 09:14:34,004 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-14 09:14:34,005 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:34,005 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-14 09:14:34,005 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689326044872.da15be0ffbf23d00411aeb89550b8a65.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689326074005"}]},"ts":"9223372036854775807"} 2023-07-14 09:14:34,005 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689326044872.d058974e29817d70d499efa41b4a43e5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689326074005"}]},"ts":"9223372036854775807"} 2023-07-14 09:14:34,007 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 09:14:34,007 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => da15be0ffbf23d00411aeb89550b8a65, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689326044872.da15be0ffbf23d00411aeb89550b8a65.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => d058974e29817d70d499efa41b4a43e5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689326044872.d058974e29817d70d499efa41b4a43e5.', STARTKEY => '1', ENDKEY => ''}] 2023-07-14 09:14:34,007 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-14 09:14:34,007 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689326074007"}]},"ts":"9223372036854775807"} 2023-07-14 09:14:34,009 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-14 09:14:34,012 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:34,014 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 46 msec 2023-07-14 09:14:34,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-14 09:14:34,081 INFO [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-14 09:14:34,093 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-14 09:14:34,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:34,100 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-14 09:14:34,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:34,105 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-14 09:14:34,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:34,147 INFO [Listener at jenkins-hbase9.apache.org/45395] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=757 (was 744) Potentially hanging thread: hconnection-0x6b086784-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2112291524_17 at /127.0.0.1:39934 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2112291524_17 at /127.0.0.1:45848 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6b086784-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2112291524_17 at /127.0.0.1:49614 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (130951516) connection to jenkins-hbase9.apache.org/172.31.2.10:40493 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x6b086784-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6b086784-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1002139109_1 at /127.0.0.1:45824 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6b086784-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6b086784-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2112291524_17 at /127.0.0.1:45844 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3987 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1002139109_1 at /127.0.0.1:39912 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=904 (was 900) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=986 (was 838) - SystemLoadAverage LEAK? -, ProcessCount=192 (was 192), AvailableMemoryMB=2423 (was 1343) - AvailableMemoryMB LEAK? - 2023-07-14 09:14:34,148 WARN [Listener at jenkins-hbase9.apache.org/45395] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-07-14 09:14:34,175 INFO [Listener at jenkins-hbase9.apache.org/45395] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=757, OpenFileDescriptor=904, MaxFileDescriptor=60000, SystemLoadAverage=986, ProcessCount=190, AvailableMemoryMB=2418 2023-07-14 09:14:34,176 WARN [Listener at jenkins-hbase9.apache.org/45395] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-07-14 09:14:34,177 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-14 09:14:34,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 09:14:34,182 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 09:14:34,182 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-14 09:14:34,183 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 09:14:34,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-14 09:14:34,186 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testEmptyExportFileSystemState/07b30a3e19852b82e300ba96c1ec4bdb 2023-07-14 09:14:34,187 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testEmptyExportFileSystemState/07b30a3e19852b82e300ba96c1ec4bdb empty. 2023-07-14 09:14:34,187 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testEmptyExportFileSystemState/07b30a3e19852b82e300ba96c1ec4bdb 2023-07-14 09:14:34,187 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testEmptyExportFileSystemState/350190b6322a6d2ad0c42474d34003cf 2023-07-14 09:14:34,188 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testEmptyExportFileSystemState/350190b6322a6d2ad0c42474d34003cf empty. 2023-07-14 09:14:34,188 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testEmptyExportFileSystemState/350190b6322a6d2ad0c42474d34003cf 2023-07-14 09:14:34,188 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-14 09:14:34,243 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-14 09:14:34,244 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 07b30a3e19852b82e300ba96c1ec4bdb, NAME => 'testtb-testEmptyExportFileSystemState,,1689326074177.07b30a3e19852b82e300ba96c1ec4bdb.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp 2023-07-14 09:14:34,246 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 350190b6322a6d2ad0c42474d34003cf, NAME => 'testtb-testEmptyExportFileSystemState,1,1689326074177.350190b6322a6d2ad0c42474d34003cf.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp 2023-07-14 09:14:34,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-14 09:14:34,325 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689326074177.07b30a3e19852b82e300ba96c1ec4bdb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:14:34,325 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 07b30a3e19852b82e300ba96c1ec4bdb, disabling compactions & flushes 2023-07-14 09:14:34,325 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689326074177.07b30a3e19852b82e300ba96c1ec4bdb. 2023-07-14 09:14:34,325 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689326074177.07b30a3e19852b82e300ba96c1ec4bdb. 2023-07-14 09:14:34,325 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689326074177.07b30a3e19852b82e300ba96c1ec4bdb. after waiting 0 ms 2023-07-14 09:14:34,325 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689326074177.07b30a3e19852b82e300ba96c1ec4bdb. 2023-07-14 09:14:34,325 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689326074177.07b30a3e19852b82e300ba96c1ec4bdb. 2023-07-14 09:14:34,325 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 07b30a3e19852b82e300ba96c1ec4bdb: 2023-07-14 09:14:34,342 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689326074177.350190b6322a6d2ad0c42474d34003cf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:14:34,342 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 350190b6322a6d2ad0c42474d34003cf, disabling compactions & flushes 2023-07-14 09:14:34,342 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689326074177.350190b6322a6d2ad0c42474d34003cf. 2023-07-14 09:14:34,342 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689326074177.350190b6322a6d2ad0c42474d34003cf. 2023-07-14 09:14:34,342 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689326074177.350190b6322a6d2ad0c42474d34003cf. after waiting 0 ms 2023-07-14 09:14:34,342 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689326074177.350190b6322a6d2ad0c42474d34003cf. 2023-07-14 09:14:34,342 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689326074177.350190b6322a6d2ad0c42474d34003cf. 2023-07-14 09:14:34,342 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 350190b6322a6d2ad0c42474d34003cf: 2023-07-14 09:14:34,345 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 09:14:34,346 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689326074177.07b30a3e19852b82e300ba96c1ec4bdb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689326074346"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689326074346"}]},"ts":"1689326074346"} 2023-07-14 09:14:34,346 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689326074177.350190b6322a6d2ad0c42474d34003cf.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689326074346"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689326074346"}]},"ts":"1689326074346"} 2023-07-14 09:14:34,348 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 09:14:34,351 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 09:14:34,352 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689326074351"}]},"ts":"1689326074351"} 2023-07-14 09:14:34,358 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-14 09:14:34,363 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 09:14:34,366 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 09:14:34,366 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 09:14:34,366 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 09:14:34,366 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 09:14:34,366 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=07b30a3e19852b82e300ba96c1ec4bdb, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=350190b6322a6d2ad0c42474d34003cf, ASSIGN}] 2023-07-14 09:14:34,370 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=350190b6322a6d2ad0c42474d34003cf, ASSIGN 2023-07-14 09:14:34,370 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=07b30a3e19852b82e300ba96c1ec4bdb, ASSIGN 2023-07-14 09:14:34,371 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=350190b6322a6d2ad0c42474d34003cf, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45899,1689325949913; forceNewPlan=false, retain=false 2023-07-14 09:14:34,371 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=07b30a3e19852b82e300ba96c1ec4bdb, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,41875,1689325950034; forceNewPlan=false, retain=false 2023-07-14 09:14:34,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-14 09:14:34,521 INFO [jenkins-hbase9:41733] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 09:14:34,525 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=350190b6322a6d2ad0c42474d34003cf, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:34,525 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689326074177.350190b6322a6d2ad0c42474d34003cf.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689326074525"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689326074525"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689326074525"}]},"ts":"1689326074525"} 2023-07-14 09:14:34,525 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=07b30a3e19852b82e300ba96c1ec4bdb, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:34,526 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689326074177.07b30a3e19852b82e300ba96c1ec4bdb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689326074525"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689326074525"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689326074525"}]},"ts":"1689326074525"} 2023-07-14 09:14:34,528 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure 350190b6322a6d2ad0c42474d34003cf, server=jenkins-hbase9.apache.org,45899,1689325949913}] 2023-07-14 09:14:34,529 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 07b30a3e19852b82e300ba96c1ec4bdb, server=jenkins-hbase9.apache.org,41875,1689325950034}] 2023-07-14 09:14:34,686 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689326074177.07b30a3e19852b82e300ba96c1ec4bdb. 2023-07-14 09:14:34,686 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689326074177.350190b6322a6d2ad0c42474d34003cf. 2023-07-14 09:14:34,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 07b30a3e19852b82e300ba96c1ec4bdb, NAME => 'testtb-testEmptyExportFileSystemState,,1689326074177.07b30a3e19852b82e300ba96c1ec4bdb.', STARTKEY => '', ENDKEY => '1'} 2023-07-14 09:14:34,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 350190b6322a6d2ad0c42474d34003cf, NAME => 'testtb-testEmptyExportFileSystemState,1,1689326074177.350190b6322a6d2ad0c42474d34003cf.', STARTKEY => '1', ENDKEY => ''} 2023-07-14 09:14:34,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689326074177.350190b6322a6d2ad0c42474d34003cf. service=AccessControlService 2023-07-14 09:14:34,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689326074177.07b30a3e19852b82e300ba96c1ec4bdb. service=AccessControlService 2023-07-14 09:14:34,687 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 09:14:34,687 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 09:14:34,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 350190b6322a6d2ad0c42474d34003cf 2023-07-14 09:14:34,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 07b30a3e19852b82e300ba96c1ec4bdb 2023-07-14 09:14:34,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689326074177.350190b6322a6d2ad0c42474d34003cf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:14:34,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689326074177.07b30a3e19852b82e300ba96c1ec4bdb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:14:34,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 350190b6322a6d2ad0c42474d34003cf 2023-07-14 09:14:34,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 07b30a3e19852b82e300ba96c1ec4bdb 2023-07-14 09:14:34,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 350190b6322a6d2ad0c42474d34003cf 2023-07-14 09:14:34,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 07b30a3e19852b82e300ba96c1ec4bdb 2023-07-14 09:14:34,689 INFO [StoreOpener-07b30a3e19852b82e300ba96c1ec4bdb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 07b30a3e19852b82e300ba96c1ec4bdb 2023-07-14 09:14:34,689 INFO [StoreOpener-350190b6322a6d2ad0c42474d34003cf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 350190b6322a6d2ad0c42474d34003cf 2023-07-14 09:14:34,690 DEBUG [StoreOpener-07b30a3e19852b82e300ba96c1ec4bdb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testEmptyExportFileSystemState/07b30a3e19852b82e300ba96c1ec4bdb/cf 2023-07-14 09:14:34,691 DEBUG [StoreOpener-07b30a3e19852b82e300ba96c1ec4bdb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testEmptyExportFileSystemState/07b30a3e19852b82e300ba96c1ec4bdb/cf 2023-07-14 09:14:34,691 INFO [StoreOpener-07b30a3e19852b82e300ba96c1ec4bdb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 07b30a3e19852b82e300ba96c1ec4bdb columnFamilyName cf 2023-07-14 09:14:34,693 DEBUG [StoreOpener-350190b6322a6d2ad0c42474d34003cf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testEmptyExportFileSystemState/350190b6322a6d2ad0c42474d34003cf/cf 2023-07-14 09:14:34,693 DEBUG [StoreOpener-350190b6322a6d2ad0c42474d34003cf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testEmptyExportFileSystemState/350190b6322a6d2ad0c42474d34003cf/cf 2023-07-14 09:14:34,693 INFO [StoreOpener-350190b6322a6d2ad0c42474d34003cf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 350190b6322a6d2ad0c42474d34003cf columnFamilyName cf 2023-07-14 09:14:34,694 INFO [StoreOpener-07b30a3e19852b82e300ba96c1ec4bdb-1] regionserver.HStore(310): Store=07b30a3e19852b82e300ba96c1ec4bdb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 09:14:34,694 INFO [StoreOpener-350190b6322a6d2ad0c42474d34003cf-1] regionserver.HStore(310): Store=350190b6322a6d2ad0c42474d34003cf/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 09:14:34,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testEmptyExportFileSystemState/07b30a3e19852b82e300ba96c1ec4bdb 2023-07-14 09:14:34,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testEmptyExportFileSystemState/350190b6322a6d2ad0c42474d34003cf 2023-07-14 09:14:34,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testEmptyExportFileSystemState/07b30a3e19852b82e300ba96c1ec4bdb 2023-07-14 09:14:34,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testEmptyExportFileSystemState/350190b6322a6d2ad0c42474d34003cf 2023-07-14 09:14:34,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 07b30a3e19852b82e300ba96c1ec4bdb 2023-07-14 09:14:34,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testEmptyExportFileSystemState/07b30a3e19852b82e300ba96c1ec4bdb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 09:14:34,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 350190b6322a6d2ad0c42474d34003cf 2023-07-14 09:14:34,702 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 07b30a3e19852b82e300ba96c1ec4bdb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73722983, jitterRate=0.09855805337429047}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 09:14:34,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 07b30a3e19852b82e300ba96c1ec4bdb: 2023-07-14 09:14:34,704 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689326074177.07b30a3e19852b82e300ba96c1ec4bdb., pid=94, masterSystemTime=1689326074682 2023-07-14 09:14:34,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testEmptyExportFileSystemState/350190b6322a6d2ad0c42474d34003cf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 09:14:34,705 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 350190b6322a6d2ad0c42474d34003cf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75363500, jitterRate=0.12300366163253784}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 09:14:34,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 350190b6322a6d2ad0c42474d34003cf: 2023-07-14 09:14:34,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689326074177.07b30a3e19852b82e300ba96c1ec4bdb. 2023-07-14 09:14:34,706 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689326074177.07b30a3e19852b82e300ba96c1ec4bdb. 2023-07-14 09:14:34,706 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689326074177.350190b6322a6d2ad0c42474d34003cf., pid=93, masterSystemTime=1689326074682 2023-07-14 09:14:34,707 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=07b30a3e19852b82e300ba96c1ec4bdb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:34,707 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689326074177.07b30a3e19852b82e300ba96c1ec4bdb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689326074707"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689326074707"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689326074707"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689326074707"}]},"ts":"1689326074707"} 2023-07-14 09:14:34,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689326074177.350190b6322a6d2ad0c42474d34003cf. 2023-07-14 09:14:34,709 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689326074177.350190b6322a6d2ad0c42474d34003cf. 2023-07-14 09:14:34,709 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=350190b6322a6d2ad0c42474d34003cf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:34,709 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689326074177.350190b6322a6d2ad0c42474d34003cf.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689326074709"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689326074709"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689326074709"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689326074709"}]},"ts":"1689326074709"} 2023-07-14 09:14:34,717 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-07-14 09:14:34,717 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 07b30a3e19852b82e300ba96c1ec4bdb, server=jenkins-hbase9.apache.org,41875,1689325950034 in 183 msec 2023-07-14 09:14:34,719 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=92 2023-07-14 09:14:34,719 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure 350190b6322a6d2ad0c42474d34003cf, server=jenkins-hbase9.apache.org,45899,1689325949913 in 185 msec 2023-07-14 09:14:34,723 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=07b30a3e19852b82e300ba96c1ec4bdb, ASSIGN in 351 msec 2023-07-14 09:14:34,725 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-14 09:14:34,725 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=350190b6322a6d2ad0c42474d34003cf, ASSIGN in 353 msec 2023-07-14 09:14:34,727 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 09:14:34,727 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689326074727"}]},"ts":"1689326074727"} 2023-07-14 09:14:34,729 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-14 09:14:34,731 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 09:14:34,732 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-14 09:14:34,733 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41875] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-14 09:14:34,735 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:34,735 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:34,735 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:34,736 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:34,737 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 09:14:34,737 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 09:14:34,737 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 09:14:34,737 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 09:14:34,739 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 560 msec 2023-07-14 09:14:34,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-14 09:14:34,788 INFO [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-14 09:14:34,791 DEBUG [Listener at jenkins-hbase9.apache.org/45395] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-14 09:14:34,791 DEBUG [Listener at jenkins-hbase9.apache.org/45395] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689326074177.07b30a3e19852b82e300ba96c1ec4bdb. 2023-07-14 09:14:34,793 INFO [Listener at jenkins-hbase9.apache.org/45395] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 09:14:34,823 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 09:14:34,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689326074823 (current time:1689326074823). 2023-07-14 09:14:34,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 09:14:34,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] zookeeper.ReadOnlyZKClient(139): Connect 0x5fd545d6 to 127.0.0.1:59920 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:14:34,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2dcc7287, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:14:34,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:14:34,864 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:41270, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:14:34,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5fd545d6 to 127.0.0.1:59920 2023-07-14 09:14:34,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:14:34,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] zookeeper.ReadOnlyZKClient(139): Connect 0x0a5df790 to 127.0.0.1:59920 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:14:34,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f53f8f8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:14:34,875 DEBUG [hconnection-0x31c5f5df-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:14:34,878 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:41278, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:14:34,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:14:34,885 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58944, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:14:34,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a5df790 to 127.0.0.1:59920 2023-07-14 09:14:34,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:14:34,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-14 09:14:34,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 09:14:34,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 09:14:34,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-14 09:14:34,890 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-14 09:14:34,897 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689326674897 2023-07-14 09:14:34,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 09:14:34,897 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-14 09:14:34,898 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 09:14:34,898 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 09:14:34,900 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-14 09:14:34,900 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-14 09:14:34,901 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 11 msec 2023-07-14 09:14:34,904 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-14 09:14:34,905 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689326674905 2023-07-14 09:14:34,998 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:14:34,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 09:14:35,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:14:35,000 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 09:14:35,200 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:14:35,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 09:14:35,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:14:35,202 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 09:14:35,327 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,327 INFO [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-14 09:14:35,327 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:35,327 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-14 09:14:35,327 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-14 09:14:35,328 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,328 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,502 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:14:35,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 09:14:35,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:14:35,504 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-14 09:14:35,570 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:35,571 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:35,571 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:35,571 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:35,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:35,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:35,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:35,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:35,571 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:35,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:35,571 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:35,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:35,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,572 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:35,572 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 09:14:35,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,572 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,572 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,572 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-14 09:14:35,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-14 09:14:35,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-14 09:14:35,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,573 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-14 09:14:35,573 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-14 09:14:35,573 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-14 09:14:35,573 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,573 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,573 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-14 09:14:35,573 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-14 09:14:35,573 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:35,573 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,576 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-14 09:14:35,576 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-14 09:14:35,576 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:35,573 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:35,577 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-14 09:14:35,578 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-14 09:14:35,576 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-14 09:14:35,578 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,37313,1689325949765' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-14 09:14:35,578 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-14 09:14:35,578 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-14 09:14:35,578 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41875,1689325950034' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-14 09:14:35,578 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45899,1689325949913' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-14 09:14:35,640 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,686 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:35,686 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:35,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:35,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:35,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:35,686 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,687 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,687 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:14:35,687 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,687 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,687 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:14:35,688 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,688 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:14:35,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:35,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:35,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:35,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:35,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:35,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:35,690 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,41875,1689325950034' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-14 09:14:35,690 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3ee8dbbc[Count = 1] remaining members to acquire global barrier 2023-07-14 09:14:35,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:35,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:35,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:35,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:35,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:35,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:35,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:35,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:35,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:35,693 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45899,1689325949913' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-14 09:14:35,693 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3ee8dbbc[Count = 0] remaining members to acquire global barrier 2023-07-14 09:14:35,693 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-14 09:14:35,694 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,755 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,755 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,755 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,755 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-14 09:14:35,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,756 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-14 09:14:35,756 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-14 09:14:35,756 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,37313,1689325949765' in zk 2023-07-14 09:14:35,756 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:35,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,756 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-14 09:14:35,756 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:35,756 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 09:14:35,759 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 09:14:35,759 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 09:14:35,759 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689326074177.350190b6322a6d2ad0c42474d34003cf. 2023-07-14 09:14:35,759 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 09:14:35,759 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689326074177.350190b6322a6d2ad0c42474d34003cf. started... 2023-07-14 09:14:35,759 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 09:14:35,759 DEBUG [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689326074177.07b30a3e19852b82e300ba96c1ec4bdb. 2023-07-14 09:14:35,759 DEBUG [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689326074177.07b30a3e19852b82e300ba96c1ec4bdb. started... 2023-07-14 09:14:35,761 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 350190b6322a6d2ad0c42474d34003cf: 2023-07-14 09:14:35,761 DEBUG [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 07b30a3e19852b82e300ba96c1ec4bdb: 2023-07-14 09:14:35,761 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689326074177.350190b6322a6d2ad0c42474d34003cf.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,761 DEBUG [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689326074177.07b30a3e19852b82e300ba96c1ec4bdb.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,761 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 09:14:35,761 DEBUG [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 09:14:35,762 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 09:14:35,762 DEBUG [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 09:14:35,780 DEBUG [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689326074177.07b30a3e19852b82e300ba96c1ec4bdb. completed. 2023-07-14 09:14:35,789 DEBUG [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689326074177.07b30a3e19852b82e300ba96c1ec4bdb. 2023-07-14 09:14:35,790 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 09:14:35,790 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 09:14:35,790 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:35,790 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-14 09:14:35,790 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,41875,1689325950034' in zk 2023-07-14 09:14:35,798 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689326074177.350190b6322a6d2ad0c42474d34003cf. completed. 2023-07-14 09:14:35,798 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689326074177.350190b6322a6d2ad0c42474d34003cf. 2023-07-14 09:14:35,798 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 09:14:35,798 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 09:14:35,798 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:35,798 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-14 09:14:35,798 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,45899,1689325949913' in zk 2023-07-14 09:14:35,833 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-14 09:14:35,833 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:35,833 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-14 09:14:35,847 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:35,847 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-14 09:14:35,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:35,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:35,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:35,848 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:35,848 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-14 09:14:35,855 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-14 09:14:35,855 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:35,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:35,855 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:35,855 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-14 09:14:35,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:35,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:35,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:35,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:35,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:35,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:35,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:35,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:35,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,41875,1689325950034': 2023-07-14 09:14:35,862 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,41875,1689325950034' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-14 09:14:35,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:35,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:35,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:35,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:35,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:35,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:35,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:35,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:35,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:35,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:35,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:35,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:35,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,45899,1689325949913': 2023-07-14 09:14:35,867 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45899,1689325949913' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-14 09:14:35,867 INFO [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-14 09:14:35,867 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 09:14:35,868 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 09:14:35,868 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,868 INFO [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 09:14:35,870 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,870 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:35,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,870 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,870 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,870 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,870 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:35,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:35,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:35,870 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:35,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:35,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:35,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:35,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:35,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:35,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:35,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:35,873 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:35,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,873 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:35,874 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:35,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:35,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:35,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:35,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:35,877 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:35,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:35,877 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:35,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,878 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:35,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:35,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:35,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:35,883 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:35,883 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,883 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:35,883 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:35,883 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:35,883 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:35,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:35,883 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,883 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,883 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:35,883 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,883 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:35,883 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:35,883 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,883 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,883 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:35,883 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:35,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:35,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:35,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:35,885 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:35,883 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-14 09:14:35,883 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:35,886 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:35,886 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:35,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:35,886 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-14 09:14:35,887 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-14 09:14:35,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:35,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:35,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:35,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:35,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:35,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:35,942 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,943 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:36,004 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:14:36,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 09:14:36,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:14:36,006 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-14 09:14:36,012 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:36,084 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-14 09:14:36,084 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:36,084 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:36,085 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689326074897Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689326075942 (+1045 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689326075942Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689326075942Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689326075957 (+15 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689326075987 (+30 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689326076084 (+97 ms) 2023-07-14 09:14:36,089 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-14 09:14:36,092 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 1.1920 sec 2023-07-14 09:14:37,006 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:14:37,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 09:14:37,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 09:14:37,012 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45899] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689326074177.350190b6322a6d2ad0c42474d34003cf. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 09:14:37,019 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41875] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689326074177.07b30a3e19852b82e300ba96c1ec4bdb. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 09:14:37,021 DEBUG [Listener at jenkins-hbase9.apache.org/45395] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-14 09:14:37,021 DEBUG [Listener at jenkins-hbase9.apache.org/45395] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689326074177.07b30a3e19852b82e300ba96c1ec4bdb. 2023-07-14 09:14:37,021 INFO [Listener at jenkins-hbase9.apache.org/45395] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 09:14:37,034 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 09:14:37,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689326077034 (current time:1689326077034). 2023-07-14 09:14:37,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 09:14:37,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] zookeeper.ReadOnlyZKClient(139): Connect 0x0f9ff0d5 to 127.0.0.1:59920 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:14:37,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@11ea87f4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:14:37,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:14:37,078 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:41292, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:14:37,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0f9ff0d5 to 127.0.0.1:59920 2023-07-14 09:14:37,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:14:37,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] zookeeper.ReadOnlyZKClient(139): Connect 0x5092f70c to 127.0.0.1:59920 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:14:37,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@20fbbc93, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:14:37,096 DEBUG [hconnection-0x65eb4a5f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:14:37,097 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:41308, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:14:37,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:14:37,108 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58948, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:14:37,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5092f70c to 127.0.0.1:59920 2023-07-14 09:14:37,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:14:37,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-14 09:14:37,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 09:14:37,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 09:14:37,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-14 09:14:37,115 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-14 09:14:37,115 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689326677115 2023-07-14 09:14:37,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 09:14:37,115 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-14 09:14:37,117 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 09:14:37,117 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 09:14:37,118 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-14 09:14:37,118 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-14 09:14:37,119 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-14 09:14:37,120 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-14 09:14:37,121 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689326677121 2023-07-14 09:14:37,140 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,140 INFO [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-14 09:14:37,140 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:37,142 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-14 09:14:37,142 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-14 09:14:37,142 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,142 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,144 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:37,144 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:37,144 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:37,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:37,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:37,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:37,144 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:37,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:37,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:37,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:37,144 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:37,144 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:37,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,145 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:37,145 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 09:14:37,145 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,145 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,145 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-14 09:14:37,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-14 09:14:37,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,146 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-14 09:14:37,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-14 09:14:37,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,146 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-14 09:14:37,146 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,146 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-14 09:14:37,146 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-14 09:14:37,146 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:37,147 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-14 09:14:37,147 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,147 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-14 09:14:37,148 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-14 09:14:37,148 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:37,148 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,37313,1689325949765' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-14 09:14:37,157 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,149 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-14 09:14:37,158 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-14 09:14:37,158 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-14 09:14:37,158 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:37,158 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41875,1689325950034' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-14 09:14:37,161 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-14 09:14:37,161 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-14 09:14:37,161 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45899,1689325949913' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-14 09:14:37,163 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,164 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,164 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,164 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:14:37,164 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:37,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:37,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:37,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:37,164 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,164 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:14:37,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:37,165 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:37,165 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:37,166 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,166 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:14:37,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:37,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:37,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:37,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:37,171 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,41875,1689325950034' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-14 09:14:37,171 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2f5a3358[Count = 1] remaining members to acquire global barrier 2023-07-14 09:14:37,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:37,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:37,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:37,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:37,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:37,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:37,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:37,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:37,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:37,175 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45899,1689325949913' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-14 09:14:37,175 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2f5a3358[Count = 0] remaining members to acquire global barrier 2023-07-14 09:14:37,175 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-14 09:14:37,175 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,181 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,181 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,181 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,181 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-14 09:14:37,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,182 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-14 09:14:37,182 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 09:14:37,182 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689326074177.350190b6322a6d2ad0c42474d34003cf. 2023-07-14 09:14:37,182 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-14 09:14:37,182 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:37,182 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-14 09:14:37,182 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689326074177.350190b6322a6d2ad0c42474d34003cf. started... 2023-07-14 09:14:37,182 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 09:14:37,182 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,37313,1689325949765' in zk 2023-07-14 09:14:37,182 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:37,182 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 09:14:37,182 INFO [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 350190b6322a6d2ad0c42474d34003cf 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-14 09:14:37,183 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 09:14:37,183 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 09:14:37,183 DEBUG [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689326074177.07b30a3e19852b82e300ba96c1ec4bdb. 2023-07-14 09:14:37,183 DEBUG [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689326074177.07b30a3e19852b82e300ba96c1ec4bdb. started... 2023-07-14 09:14:37,183 INFO [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 07b30a3e19852b82e300ba96c1ec4bdb 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-14 09:14:37,184 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-14 09:14:37,184 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:37,184 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-14 09:14:37,217 INFO [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230714d99ce58c59bd4dc688ad5ec96cd22b10 to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230714d99ce58c59bd4dc688ad5ec96cd22b10 2023-07-14 09:14:37,217 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:14:37,217 INFO [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230714e9875853817b4510a8df6b5bc027944e to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230714e9875853817b4510a8df6b5bc027944e 2023-07-14 09:14:37,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 09:14:37,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:14:37,219 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 09:14:37,234 INFO [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testEmptyExportFileSystemState/350190b6322a6d2ad0c42474d34003cf/.tmp/cf/f7f23b11058a45d4bf914ab29d9005d5 2023-07-14 09:14:37,236 INFO [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testEmptyExportFileSystemState/07b30a3e19852b82e300ba96c1ec4bdb/.tmp/cf/6dc8dcece0b04d3793bf5dd7b431c962 2023-07-14 09:14:37,240 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testEmptyExportFileSystemState/350190b6322a6d2ad0c42474d34003cf/.tmp/cf/f7f23b11058a45d4bf914ab29d9005d5 as hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testEmptyExportFileSystemState/350190b6322a6d2ad0c42474d34003cf/cf/f7f23b11058a45d4bf914ab29d9005d5 2023-07-14 09:14:37,244 DEBUG [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testEmptyExportFileSystemState/07b30a3e19852b82e300ba96c1ec4bdb/.tmp/cf/6dc8dcece0b04d3793bf5dd7b431c962 as hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testEmptyExportFileSystemState/07b30a3e19852b82e300ba96c1ec4bdb/cf/6dc8dcece0b04d3793bf5dd7b431c962 2023-07-14 09:14:37,246 INFO [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testEmptyExportFileSystemState/350190b6322a6d2ad0c42474d34003cf/cf/f7f23b11058a45d4bf914ab29d9005d5, entries=47, sequenceid=6, filesize=13.1 K 2023-07-14 09:14:37,247 INFO [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 350190b6322a6d2ad0c42474d34003cf in 65ms, sequenceid=6, compaction requested=false 2023-07-14 09:14:37,247 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-14 09:14:37,247 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 350190b6322a6d2ad0c42474d34003cf: 2023-07-14 09:14:37,247 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689326074177.350190b6322a6d2ad0c42474d34003cf.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,249 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 09:14:37,249 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testEmptyExportFileSystemState/350190b6322a6d2ad0c42474d34003cf/cf/f7f23b11058a45d4bf914ab29d9005d5] hfiles 2023-07-14 09:14:37,250 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testEmptyExportFileSystemState/350190b6322a6d2ad0c42474d34003cf/cf/f7f23b11058a45d4bf914ab29d9005d5 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,252 INFO [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testEmptyExportFileSystemState/07b30a3e19852b82e300ba96c1ec4bdb/cf/6dc8dcece0b04d3793bf5dd7b431c962, entries=3, sequenceid=6, filesize=5.4 K 2023-07-14 09:14:37,253 INFO [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 07b30a3e19852b82e300ba96c1ec4bdb in 70ms, sequenceid=6, compaction requested=false 2023-07-14 09:14:37,255 DEBUG [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 07b30a3e19852b82e300ba96c1ec4bdb: 2023-07-14 09:14:37,255 DEBUG [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689326074177.07b30a3e19852b82e300ba96c1ec4bdb.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,255 DEBUG [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 09:14:37,255 DEBUG [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testEmptyExportFileSystemState/07b30a3e19852b82e300ba96c1ec4bdb/cf/6dc8dcece0b04d3793bf5dd7b431c962] hfiles 2023-07-14 09:14:37,255 DEBUG [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testEmptyExportFileSystemState/07b30a3e19852b82e300ba96c1ec4bdb/cf/6dc8dcece0b04d3793bf5dd7b431c962 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,260 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689326074177.350190b6322a6d2ad0c42474d34003cf. completed. 2023-07-14 09:14:37,260 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689326074177.350190b6322a6d2ad0c42474d34003cf. 2023-07-14 09:14:37,260 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 09:14:37,260 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 09:14:37,260 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:37,260 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-14 09:14:37,260 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,45899,1689325949913' in zk 2023-07-14 09:14:37,263 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-14 09:14:37,263 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:37,263 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:37,263 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-14 09:14:37,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:37,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:37,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:37,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:37,263 DEBUG [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689326074177.07b30a3e19852b82e300ba96c1ec4bdb. completed. 2023-07-14 09:14:37,263 DEBUG [rs(jenkins-hbase9.apache.org,41875,1689325950034)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689326074177.07b30a3e19852b82e300ba96c1ec4bdb. 2023-07-14 09:14:37,264 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 09:14:37,264 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 09:14:37,264 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:37,264 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-14 09:14:37,264 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,41875,1689325950034' in zk 2023-07-14 09:14:37,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:37,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,266 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-14 09:14:37,266 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:37,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:37,266 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:37,267 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-14 09:14:37,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:37,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:37,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:37,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:37,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:37,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:37,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,45899,1689325949913': 2023-07-14 09:14:37,271 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45899,1689325949913' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-14 09:14:37,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:37,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:37,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:37,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:37,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:37,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:37,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:37,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:37,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:37,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:37,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:37,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:37,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,41875,1689325950034': 2023-07-14 09:14:37,277 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,41875,1689325950034' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-14 09:14:37,277 INFO [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-14 09:14:37,278 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 09:14:37,278 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 09:14:37,278 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,278 INFO [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 09:14:37,280 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,281 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:37,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,281 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,281 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:37,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:37,281 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,281 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:37,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,281 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:37,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:37,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:37,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:37,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:37,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:37,282 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:37,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,282 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:37,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:37,283 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:37,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:37,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:37,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:37,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:37,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:37,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:37,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,288 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:37,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:37,288 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:37,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:37,289 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:37,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:37,292 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:37,292 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:37,292 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,292 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:37,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:37,292 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:37,292 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:37,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:37,293 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:37,293 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:37,293 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:37,292 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:37,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:37,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:37,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:37,292 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:37,293 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,295 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-14 09:14:37,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:37,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:37,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:37,293 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,295 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:37,295 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,295 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:37,295 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:37,295 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,295 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:37,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:37,295 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,295 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-14 09:14:37,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:37,296 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230714d99ce58c59bd4dc688ad5ec96cd22b10, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230714e9875853817b4510a8df6b5bc027944e] mob files 2023-07-14 09:14:37,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:37,296 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230714d99ce58c59bd4dc688ad5ec96cd22b10 2023-07-14 09:14:37,297 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230714e9875853817b4510a8df6b5bc027944e 2023-07-14 09:14:37,319 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,319 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,342 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,365 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-14 09:14:37,366 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,366 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,366 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689326077116Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689326077318 (+202 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689326077319 (+1 ms)Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689326077319Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689326077323 (+4 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689326077335 (+12 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689326077365 (+30 ms) 2023-07-14 09:14:37,369 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-14 09:14:37,373 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 252 msec 2023-07-14 09:14:37,420 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:14:37,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 09:14:37,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 09:14:37,424 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/export-test/export-1689326077424 2023-07-14 09:14:37,424 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43771, tgtDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/export-test/export-1689326077424, rawTgtDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/export-test/export-1689326077424, srcFsUri=hdfs://localhost:43771, srcDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8 2023-07-14 09:14:37,458 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43771, inputRoot=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8 2023-07-14 09:14:37,459 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1963058091_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/export-test/export-1689326077424, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/export-test/export-1689326077424/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,459 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43771, inputRoot=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8, snapshotDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-14 09:14:37,476 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/export-test/export-1689326077424/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:37,576 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:37,576 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:37,577 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:37,577 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:37,578 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:37,578 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:37,583 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:37,673 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/hadoop-6271389034622351504.jar 2023-07-14 09:14:37,674 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:37,674 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:37,675 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:37,675 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:37,676 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:37,676 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:37,677 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 09:14:37,677 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 09:14:37,678 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 09:14:37,679 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 09:14:37,679 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 09:14:37,680 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 09:14:37,680 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 09:14:37,681 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 09:14:37,681 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 09:14:37,684 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 09:14:37,685 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:14:37,686 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:14:37,687 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 09:14:37,687 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:14:37,687 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:14:37,688 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 09:14:37,689 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 09:14:38,197 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960675_0005_000001 (auth:SIMPLE) 2023-07-14 09:14:39,054 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 09:14:39,491 WARN [Listener at jenkins-hbase9.apache.org/45395] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 09:14:39,497 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-14 09:14:39,721 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 09:14:39,721 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 09:14:40,215 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960675_0006_000001 (auth:SIMPLE) 2023-07-14 09:14:48,520 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960675_0006_000001 (auth:SIMPLE) 2023-07-14 09:14:51,063 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 09:14:51,066 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 09:14:51,073 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:51,073 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 09:14:51,074 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 09:14:51,074 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2112291524_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:51,074 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(367): hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-14 09:14:51,074 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(367): hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-14 09:14:51,074 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2112291524_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/export-test/export-1689326077424/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/export-test/export-1689326077424/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:51,075 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(367): hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/export-test/export-1689326077424/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-14 09:14:51,075 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(367): hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/export-test/export-1689326077424/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-14 09:14:51,080 INFO [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-14 09:14:51,080 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testEmptyExportFileSystemState 2023-07-14 09:14:51,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 09:14:51,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-14 09:14:51,084 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689326091084"}]},"ts":"1689326091084"} 2023-07-14 09:14:51,086 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-14 09:14:51,087 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-14 09:14:51,088 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=07b30a3e19852b82e300ba96c1ec4bdb, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=350190b6322a6d2ad0c42474d34003cf, UNASSIGN}] 2023-07-14 09:14:51,092 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=07b30a3e19852b82e300ba96c1ec4bdb, UNASSIGN 2023-07-14 09:14:51,092 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=350190b6322a6d2ad0c42474d34003cf, UNASSIGN 2023-07-14 09:14:51,093 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=07b30a3e19852b82e300ba96c1ec4bdb, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:51,093 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=350190b6322a6d2ad0c42474d34003cf, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:51,093 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689326074177.07b30a3e19852b82e300ba96c1ec4bdb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689326091093"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689326091093"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689326091093"}]},"ts":"1689326091093"} 2023-07-14 09:14:51,093 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689326074177.350190b6322a6d2ad0c42474d34003cf.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689326091093"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689326091093"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689326091093"}]},"ts":"1689326091093"} 2023-07-14 09:14:51,095 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 07b30a3e19852b82e300ba96c1ec4bdb, server=jenkins-hbase9.apache.org,41875,1689325950034}] 2023-07-14 09:14:51,097 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 350190b6322a6d2ad0c42474d34003cf, server=jenkins-hbase9.apache.org,45899,1689325949913}] 2023-07-14 09:14:51,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-14 09:14:51,247 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 07b30a3e19852b82e300ba96c1ec4bdb 2023-07-14 09:14:51,247 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 07b30a3e19852b82e300ba96c1ec4bdb, disabling compactions & flushes 2023-07-14 09:14:51,248 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689326074177.07b30a3e19852b82e300ba96c1ec4bdb. 2023-07-14 09:14:51,248 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689326074177.07b30a3e19852b82e300ba96c1ec4bdb. 2023-07-14 09:14:51,248 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689326074177.07b30a3e19852b82e300ba96c1ec4bdb. after waiting 0 ms 2023-07-14 09:14:51,248 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689326074177.07b30a3e19852b82e300ba96c1ec4bdb. 2023-07-14 09:14:51,250 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 350190b6322a6d2ad0c42474d34003cf 2023-07-14 09:14:51,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 350190b6322a6d2ad0c42474d34003cf, disabling compactions & flushes 2023-07-14 09:14:51,250 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689326074177.350190b6322a6d2ad0c42474d34003cf. 2023-07-14 09:14:51,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689326074177.350190b6322a6d2ad0c42474d34003cf. 2023-07-14 09:14:51,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689326074177.350190b6322a6d2ad0c42474d34003cf. after waiting 0 ms 2023-07-14 09:14:51,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689326074177.350190b6322a6d2ad0c42474d34003cf. 2023-07-14 09:14:51,263 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testEmptyExportFileSystemState/07b30a3e19852b82e300ba96c1ec4bdb/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 09:14:51,263 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 09:14:51,264 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689326074177.07b30a3e19852b82e300ba96c1ec4bdb. 2023-07-14 09:14:51,264 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testEmptyExportFileSystemState/350190b6322a6d2ad0c42474d34003cf/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 09:14:51,264 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 07b30a3e19852b82e300ba96c1ec4bdb: 2023-07-14 09:14:51,265 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 09:14:51,266 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689326074177.350190b6322a6d2ad0c42474d34003cf. 2023-07-14 09:14:51,266 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 350190b6322a6d2ad0c42474d34003cf: 2023-07-14 09:14:51,266 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 07b30a3e19852b82e300ba96c1ec4bdb 2023-07-14 09:14:51,267 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=07b30a3e19852b82e300ba96c1ec4bdb, regionState=CLOSED 2023-07-14 09:14:51,267 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689326074177.07b30a3e19852b82e300ba96c1ec4bdb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689326091267"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689326091267"}]},"ts":"1689326091267"} 2023-07-14 09:14:51,267 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 350190b6322a6d2ad0c42474d34003cf 2023-07-14 09:14:51,268 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=350190b6322a6d2ad0c42474d34003cf, regionState=CLOSED 2023-07-14 09:14:51,268 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689326074177.350190b6322a6d2ad0c42474d34003cf.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689326091268"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689326091268"}]},"ts":"1689326091268"} 2023-07-14 09:14:51,273 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-14 09:14:51,273 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-14 09:14:51,273 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 350190b6322a6d2ad0c42474d34003cf, server=jenkins-hbase9.apache.org,45899,1689325949913 in 173 msec 2023-07-14 09:14:51,273 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 07b30a3e19852b82e300ba96c1ec4bdb, server=jenkins-hbase9.apache.org,41875,1689325950034 in 175 msec 2023-07-14 09:14:51,275 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=07b30a3e19852b82e300ba96c1ec4bdb, UNASSIGN in 185 msec 2023-07-14 09:14:51,275 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-14 09:14:51,275 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=350190b6322a6d2ad0c42474d34003cf, UNASSIGN in 185 msec 2023-07-14 09:14:51,276 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689326091276"}]},"ts":"1689326091276"} 2023-07-14 09:14:51,277 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-14 09:14:51,278 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-14 09:14:51,282 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 199 msec 2023-07-14 09:14:51,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-14 09:14:51,388 INFO [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-14 09:14:51,389 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testEmptyExportFileSystemState 2023-07-14 09:14:51,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 09:14:51,395 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 09:14:51,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-14 09:14:51,396 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 09:14:51,398 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41875] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-14 09:14:51,414 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testEmptyExportFileSystemState/07b30a3e19852b82e300ba96c1ec4bdb 2023-07-14 09:14:51,414 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testEmptyExportFileSystemState/350190b6322a6d2ad0c42474d34003cf 2023-07-14 09:14:51,417 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testEmptyExportFileSystemState/350190b6322a6d2ad0c42474d34003cf/cf, FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testEmptyExportFileSystemState/350190b6322a6d2ad0c42474d34003cf/recovered.edits] 2023-07-14 09:14:51,431 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testEmptyExportFileSystemState/350190b6322a6d2ad0c42474d34003cf/cf/f7f23b11058a45d4bf914ab29d9005d5 to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/archive/data/default/testtb-testEmptyExportFileSystemState/350190b6322a6d2ad0c42474d34003cf/cf/f7f23b11058a45d4bf914ab29d9005d5 2023-07-14 09:14:51,438 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testEmptyExportFileSystemState/350190b6322a6d2ad0c42474d34003cf/recovered.edits/9.seqid to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/archive/data/default/testtb-testEmptyExportFileSystemState/350190b6322a6d2ad0c42474d34003cf/recovered.edits/9.seqid 2023-07-14 09:14:51,439 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testEmptyExportFileSystemState/350190b6322a6d2ad0c42474d34003cf 2023-07-14 09:14:51,443 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testEmptyExportFileSystemState/07b30a3e19852b82e300ba96c1ec4bdb/cf, FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testEmptyExportFileSystemState/07b30a3e19852b82e300ba96c1ec4bdb/recovered.edits] 2023-07-14 09:14:51,456 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testEmptyExportFileSystemState/07b30a3e19852b82e300ba96c1ec4bdb/cf/6dc8dcece0b04d3793bf5dd7b431c962 to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/archive/data/default/testtb-testEmptyExportFileSystemState/07b30a3e19852b82e300ba96c1ec4bdb/cf/6dc8dcece0b04d3793bf5dd7b431c962 2023-07-14 09:14:51,461 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testEmptyExportFileSystemState/07b30a3e19852b82e300ba96c1ec4bdb/recovered.edits/9.seqid to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/archive/data/default/testtb-testEmptyExportFileSystemState/07b30a3e19852b82e300ba96c1ec4bdb/recovered.edits/9.seqid 2023-07-14 09:14:51,462 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testEmptyExportFileSystemState/07b30a3e19852b82e300ba96c1ec4bdb 2023-07-14 09:14:51,462 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-14 09:14:51,463 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-14 09:14:51,465 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-14 09:14:51,473 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230714d99ce58c59bd4dc688ad5ec96cd22b10 to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230714d99ce58c59bd4dc688ad5ec96cd22b10 2023-07-14 09:14:51,475 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230714e9875853817b4510a8df6b5bc027944e to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230714e9875853817b4510a8df6b5bc027944e 2023-07-14 09:14:51,477 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-14 09:14:51,480 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 09:14:51,482 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-14 09:14:51,485 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-14 09:14:51,486 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 09:14:51,486 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-14 09:14:51,486 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689326074177.07b30a3e19852b82e300ba96c1ec4bdb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689326091486"}]},"ts":"9223372036854775807"} 2023-07-14 09:14:51,486 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689326074177.350190b6322a6d2ad0c42474d34003cf.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689326091486"}]},"ts":"9223372036854775807"} 2023-07-14 09:14:51,489 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 09:14:51,489 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 07b30a3e19852b82e300ba96c1ec4bdb, NAME => 'testtb-testEmptyExportFileSystemState,,1689326074177.07b30a3e19852b82e300ba96c1ec4bdb.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 350190b6322a6d2ad0c42474d34003cf, NAME => 'testtb-testEmptyExportFileSystemState,1,1689326074177.350190b6322a6d2ad0c42474d34003cf.', STARTKEY => '1', ENDKEY => ''}] 2023-07-14 09:14:51,489 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-14 09:14:51,489 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689326091489"}]},"ts":"9223372036854775807"} 2023-07-14 09:14:51,500 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-14 09:14:51,746 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 09:14:51,747 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 357 msec 2023-07-14 09:14:51,815 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 09:14:51,815 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 09:14:51,815 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 09:14:51,815 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 09:14:51,816 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-14 09:14:51,816 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-14 09:14:51,817 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-14 09:14:51,817 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-14 09:14:51,899 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 09:14:51,899 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 09:14:51,899 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:51,899 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 09:14:51,899 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:51,899 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:51,899 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 09:14:51,899 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:51,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-14 09:14:51,900 INFO [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-14 09:14:51,906 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-14 09:14:51,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:51,910 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-14 09:14:51,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:51,948 INFO [Listener at jenkins-hbase9.apache.org/45395] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=758 (was 757) Potentially hanging thread: hconnection-0x6b086784-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2112291524_17 at /127.0.0.1:53244 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6b086784-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2112291524_17 at /127.0.0.1:59082 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6b086784-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1684317339_1 at /127.0.0.1:59056 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4674 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1684317339_1 at /127.0.0.1:53214 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6b086784-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (130951516) connection to jenkins-hbase9.apache.org/172.31.2.10:45713 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2112291524_17 at /127.0.0.1:35806 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (130951516) connection to jenkins-hbase9.apache.org/172.31.2.10:44391 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=904 (was 904), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1050 (was 986) - SystemLoadAverage LEAK? -, ProcessCount=187 (was 190), AvailableMemoryMB=2400 (was 2418) 2023-07-14 09:14:51,948 WARN [Listener at jenkins-hbase9.apache.org/45395] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-07-14 09:14:51,970 INFO [Listener at jenkins-hbase9.apache.org/45395] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=758, OpenFileDescriptor=904, MaxFileDescriptor=60000, SystemLoadAverage=1050, ProcessCount=187, AvailableMemoryMB=2395 2023-07-14 09:14:51,970 WARN [Listener at jenkins-hbase9.apache.org/45395] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-07-14 09:14:51,972 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-14 09:14:51,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:51,975 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 09:14:51,976 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-14 09:14:51,976 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 09:14:51,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-14 09:14:51,978 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2355ebf4f35b8719688862eecc662ae6 2023-07-14 09:14:51,978 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/be9d9f0b1b469b1e32dacb84e7be0125 2023-07-14 09:14:51,979 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2355ebf4f35b8719688862eecc662ae6 empty. 2023-07-14 09:14:51,979 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/be9d9f0b1b469b1e32dacb84e7be0125 empty. 2023-07-14 09:14:51,980 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2355ebf4f35b8719688862eecc662ae6 2023-07-14 09:14:51,980 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/be9d9f0b1b469b1e32dacb84e7be0125 2023-07-14 09:14:51,980 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-14 09:14:51,999 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-14 09:14:52,000 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2355ebf4f35b8719688862eecc662ae6, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689326091972.2355ebf4f35b8719688862eecc662ae6.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp 2023-07-14 09:14:52,000 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => be9d9f0b1b469b1e32dacb84e7be0125, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689326091972.be9d9f0b1b469b1e32dacb84e7be0125.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp 2023-07-14 09:14:52,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-14 09:14:52,101 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689326091972.2355ebf4f35b8719688862eecc662ae6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:14:52,101 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 2355ebf4f35b8719688862eecc662ae6, disabling compactions & flushes 2023-07-14 09:14:52,101 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689326091972.2355ebf4f35b8719688862eecc662ae6. 2023-07-14 09:14:52,101 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689326091972.be9d9f0b1b469b1e32dacb84e7be0125.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:14:52,101 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689326091972.2355ebf4f35b8719688862eecc662ae6. 2023-07-14 09:14:52,101 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689326091972.2355ebf4f35b8719688862eecc662ae6. after waiting 0 ms 2023-07-14 09:14:52,101 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing be9d9f0b1b469b1e32dacb84e7be0125, disabling compactions & flushes 2023-07-14 09:14:52,101 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689326091972.2355ebf4f35b8719688862eecc662ae6. 2023-07-14 09:14:52,101 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689326091972.be9d9f0b1b469b1e32dacb84e7be0125. 2023-07-14 09:14:52,101 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689326091972.2355ebf4f35b8719688862eecc662ae6. 2023-07-14 09:14:52,101 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689326091972.be9d9f0b1b469b1e32dacb84e7be0125. 2023-07-14 09:14:52,102 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 2355ebf4f35b8719688862eecc662ae6: 2023-07-14 09:14:52,102 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689326091972.be9d9f0b1b469b1e32dacb84e7be0125. after waiting 0 ms 2023-07-14 09:14:52,102 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689326091972.be9d9f0b1b469b1e32dacb84e7be0125. 2023-07-14 09:14:52,102 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689326091972.be9d9f0b1b469b1e32dacb84e7be0125. 2023-07-14 09:14:52,102 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for be9d9f0b1b469b1e32dacb84e7be0125: 2023-07-14 09:14:52,104 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 09:14:52,105 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689326091972.2355ebf4f35b8719688862eecc662ae6.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689326092105"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689326092105"}]},"ts":"1689326092105"} 2023-07-14 09:14:52,105 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689326091972.be9d9f0b1b469b1e32dacb84e7be0125.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689326092105"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689326092105"}]},"ts":"1689326092105"} 2023-07-14 09:14:52,108 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 09:14:52,109 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 09:14:52,109 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689326092109"}]},"ts":"1689326092109"} 2023-07-14 09:14:52,111 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-14 09:14:52,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-14 09:14:52,406 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 09:14:52,408 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 09:14:52,408 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 09:14:52,408 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 09:14:52,408 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 09:14:52,408 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2355ebf4f35b8719688862eecc662ae6, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=be9d9f0b1b469b1e32dacb84e7be0125, ASSIGN}] 2023-07-14 09:14:52,411 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=be9d9f0b1b469b1e32dacb84e7be0125, ASSIGN 2023-07-14 09:14:52,412 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2355ebf4f35b8719688862eecc662ae6, ASSIGN 2023-07-14 09:14:52,412 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=be9d9f0b1b469b1e32dacb84e7be0125, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,37313,1689325949765; forceNewPlan=false, retain=false 2023-07-14 09:14:52,412 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2355ebf4f35b8719688862eecc662ae6, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45899,1689325949913; forceNewPlan=false, retain=false 2023-07-14 09:14:52,562 INFO [jenkins-hbase9:41733] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 09:14:52,566 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=2355ebf4f35b8719688862eecc662ae6, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:52,566 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=be9d9f0b1b469b1e32dacb84e7be0125, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:52,566 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689326091972.2355ebf4f35b8719688862eecc662ae6.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689326092566"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689326092566"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689326092566"}]},"ts":"1689326092566"} 2023-07-14 09:14:52,566 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689326091972.be9d9f0b1b469b1e32dacb84e7be0125.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689326092566"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689326092566"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689326092566"}]},"ts":"1689326092566"} 2023-07-14 09:14:52,568 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure 2355ebf4f35b8719688862eecc662ae6, server=jenkins-hbase9.apache.org,45899,1689325949913}] 2023-07-14 09:14:52,569 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure be9d9f0b1b469b1e32dacb84e7be0125, server=jenkins-hbase9.apache.org,37313,1689325949765}] 2023-07-14 09:14:52,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-14 09:14:52,727 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689326091972.2355ebf4f35b8719688862eecc662ae6. 2023-07-14 09:14:52,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2355ebf4f35b8719688862eecc662ae6, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689326091972.2355ebf4f35b8719688862eecc662ae6.', STARTKEY => '', ENDKEY => '1'} 2023-07-14 09:14:52,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689326091972.2355ebf4f35b8719688862eecc662ae6. service=AccessControlService 2023-07-14 09:14:52,728 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 09:14:52,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 2355ebf4f35b8719688862eecc662ae6 2023-07-14 09:14:52,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689326091972.2355ebf4f35b8719688862eecc662ae6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:14:52,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 2355ebf4f35b8719688862eecc662ae6 2023-07-14 09:14:52,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 2355ebf4f35b8719688862eecc662ae6 2023-07-14 09:14:52,729 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689326091972.be9d9f0b1b469b1e32dacb84e7be0125. 2023-07-14 09:14:52,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => be9d9f0b1b469b1e32dacb84e7be0125, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689326091972.be9d9f0b1b469b1e32dacb84e7be0125.', STARTKEY => '1', ENDKEY => ''} 2023-07-14 09:14:52,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689326091972.be9d9f0b1b469b1e32dacb84e7be0125. service=AccessControlService 2023-07-14 09:14:52,729 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 09:14:52,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp be9d9f0b1b469b1e32dacb84e7be0125 2023-07-14 09:14:52,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689326091972.be9d9f0b1b469b1e32dacb84e7be0125.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:14:52,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for be9d9f0b1b469b1e32dacb84e7be0125 2023-07-14 09:14:52,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for be9d9f0b1b469b1e32dacb84e7be0125 2023-07-14 09:14:52,731 INFO [StoreOpener-2355ebf4f35b8719688862eecc662ae6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2355ebf4f35b8719688862eecc662ae6 2023-07-14 09:14:52,731 INFO [StoreOpener-be9d9f0b1b469b1e32dacb84e7be0125-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region be9d9f0b1b469b1e32dacb84e7be0125 2023-07-14 09:14:52,732 DEBUG [StoreOpener-2355ebf4f35b8719688862eecc662ae6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithSkipTmp/2355ebf4f35b8719688862eecc662ae6/cf 2023-07-14 09:14:52,732 DEBUG [StoreOpener-2355ebf4f35b8719688862eecc662ae6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithSkipTmp/2355ebf4f35b8719688862eecc662ae6/cf 2023-07-14 09:14:52,733 DEBUG [StoreOpener-be9d9f0b1b469b1e32dacb84e7be0125-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithSkipTmp/be9d9f0b1b469b1e32dacb84e7be0125/cf 2023-07-14 09:14:52,733 INFO [StoreOpener-2355ebf4f35b8719688862eecc662ae6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2355ebf4f35b8719688862eecc662ae6 columnFamilyName cf 2023-07-14 09:14:52,733 DEBUG [StoreOpener-be9d9f0b1b469b1e32dacb84e7be0125-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithSkipTmp/be9d9f0b1b469b1e32dacb84e7be0125/cf 2023-07-14 09:14:52,733 INFO [StoreOpener-be9d9f0b1b469b1e32dacb84e7be0125-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region be9d9f0b1b469b1e32dacb84e7be0125 columnFamilyName cf 2023-07-14 09:14:52,734 INFO [StoreOpener-be9d9f0b1b469b1e32dacb84e7be0125-1] regionserver.HStore(310): Store=be9d9f0b1b469b1e32dacb84e7be0125/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 09:14:52,735 INFO [StoreOpener-2355ebf4f35b8719688862eecc662ae6-1] regionserver.HStore(310): Store=2355ebf4f35b8719688862eecc662ae6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 09:14:52,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithSkipTmp/be9d9f0b1b469b1e32dacb84e7be0125 2023-07-14 09:14:52,736 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithSkipTmp/be9d9f0b1b469b1e32dacb84e7be0125 2023-07-14 09:14:52,736 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithSkipTmp/2355ebf4f35b8719688862eecc662ae6 2023-07-14 09:14:52,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithSkipTmp/2355ebf4f35b8719688862eecc662ae6 2023-07-14 09:14:52,740 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 2355ebf4f35b8719688862eecc662ae6 2023-07-14 09:14:52,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for be9d9f0b1b469b1e32dacb84e7be0125 2023-07-14 09:14:52,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithSkipTmp/2355ebf4f35b8719688862eecc662ae6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 09:14:52,743 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 2355ebf4f35b8719688862eecc662ae6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74054888, jitterRate=0.10350382328033447}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 09:14:52,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 2355ebf4f35b8719688862eecc662ae6: 2023-07-14 09:14:52,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithSkipTmp/be9d9f0b1b469b1e32dacb84e7be0125/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 09:14:52,744 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689326091972.2355ebf4f35b8719688862eecc662ae6., pid=108, masterSystemTime=1689326092721 2023-07-14 09:14:52,744 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened be9d9f0b1b469b1e32dacb84e7be0125; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68427472, jitterRate=0.01964879035949707}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 09:14:52,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for be9d9f0b1b469b1e32dacb84e7be0125: 2023-07-14 09:14:52,745 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689326091972.be9d9f0b1b469b1e32dacb84e7be0125., pid=109, masterSystemTime=1689326092721 2023-07-14 09:14:52,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689326091972.2355ebf4f35b8719688862eecc662ae6. 2023-07-14 09:14:52,746 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689326091972.2355ebf4f35b8719688862eecc662ae6. 2023-07-14 09:14:52,750 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=2355ebf4f35b8719688862eecc662ae6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:52,750 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689326091972.2355ebf4f35b8719688862eecc662ae6.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689326092750"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689326092750"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689326092750"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689326092750"}]},"ts":"1689326092750"} 2023-07-14 09:14:52,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689326091972.be9d9f0b1b469b1e32dacb84e7be0125. 2023-07-14 09:14:52,751 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689326091972.be9d9f0b1b469b1e32dacb84e7be0125. 2023-07-14 09:14:52,751 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=be9d9f0b1b469b1e32dacb84e7be0125, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:52,751 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689326091972.be9d9f0b1b469b1e32dacb84e7be0125.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689326092751"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689326092751"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689326092751"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689326092751"}]},"ts":"1689326092751"} 2023-07-14 09:14:52,755 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=106 2023-07-14 09:14:52,755 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure 2355ebf4f35b8719688862eecc662ae6, server=jenkins-hbase9.apache.org,45899,1689325949913 in 184 msec 2023-07-14 09:14:52,756 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-14 09:14:52,756 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure be9d9f0b1b469b1e32dacb84e7be0125, server=jenkins-hbase9.apache.org,37313,1689325949765 in 185 msec 2023-07-14 09:14:52,757 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2355ebf4f35b8719688862eecc662ae6, ASSIGN in 347 msec 2023-07-14 09:14:52,759 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-07-14 09:14:52,759 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=be9d9f0b1b469b1e32dacb84e7be0125, ASSIGN in 348 msec 2023-07-14 09:14:52,760 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 09:14:52,760 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689326092760"}]},"ts":"1689326092760"} 2023-07-14 09:14:52,762 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-14 09:14:52,793 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 09:14:52,793 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-14 09:14:52,796 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41875] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-14 09:14:52,822 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:52,822 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:52,822 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:52,822 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:52,845 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-14 09:14:52,845 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-14 09:14:52,845 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-14 09:14:52,846 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-14 09:14:52,851 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 877 msec 2023-07-14 09:14:53,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-14 09:14:53,082 INFO [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-14 09:14:53,088 DEBUG [Listener at jenkins-hbase9.apache.org/45395] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,088 DEBUG [Listener at jenkins-hbase9.apache.org/45395] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689326091972.2355ebf4f35b8719688862eecc662ae6. 2023-07-14 09:14:53,090 INFO [Listener at jenkins-hbase9.apache.org/45395] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 09:14:53,140 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-14 09:14:53,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689326093141 (current time:1689326093141). 2023-07-14 09:14:53,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 09:14:53,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] zookeeper.ReadOnlyZKClient(139): Connect 0x155b6a03 to 127.0.0.1:59920 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:14:53,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e15301, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:14:53,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:14:53,190 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:51968, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:14:53,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x155b6a03 to 127.0.0.1:59920 2023-07-14 09:14:53,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:14:53,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] zookeeper.ReadOnlyZKClient(139): Connect 0x33ffc890 to 127.0.0.1:59920 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:14:53,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7dbaa79e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:14:53,311 DEBUG [hconnection-0x70ce9a73-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:14:53,316 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:51980, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:14:53,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:14:53,328 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:53340, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:14:53,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x33ffc890 to 127.0.0.1:59920 2023-07-14 09:14:53,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:14:53,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-14 09:14:53,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 09:14:53,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-14 09:14:53,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-14 09:14:53,339 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-14 09:14:53,341 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689326693341 2023-07-14 09:14:53,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-14 09:14:53,341 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,344 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 09:14:53,344 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 09:14:53,344 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-14 09:14:53,346 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-14 09:14:53,349 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 14 msec 2023-07-14 09:14:53,350 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-14 09:14:53,351 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689326693351 2023-07-14 09:14:53,444 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:14:53,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 09:14:53,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:14:53,469 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 09:14:53,477 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,478 INFO [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-14 09:14:53,478 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:53,478 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-14 09:14:53,478 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-14 09:14:53,478 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,478 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,480 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:53,480 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:53,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:53,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:53,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:53,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:53,480 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:53,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,480 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:53,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:53,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:53,481 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,481 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-14 09:14:53,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,482 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-14 09:14:53,482 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:53,482 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:53,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-14 09:14:53,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,482 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-14 09:14:53,483 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:53,483 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 09:14:53,485 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-14 09:14:53,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,486 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-14 09:14:53,488 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,488 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-14 09:14:53,488 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:53,490 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,490 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-14 09:14:53,490 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:53,493 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,494 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-14 09:14:53,494 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:53,496 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-14 09:14:53,496 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-14 09:14:53,496 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,37313,1689325949765' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-14 09:14:53,496 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-14 09:14:53,496 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-14 09:14:53,496 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-14 09:14:53,496 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45899,1689325949913' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-14 09:14:53,496 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-14 09:14:53,497 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41875,1689325950034' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-14 09:14:53,502 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:53,502 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:53,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:53,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:53,503 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,503 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,503 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:53,503 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:14:53,503 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:53,504 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,504 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:14:53,504 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,504 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:14:53,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:53,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:53,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:53,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:53,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:53,507 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,37313,1689325949765' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-14 09:14:53,507 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b43fad9[Count = 1] remaining members to acquire global barrier 2023-07-14 09:14:53,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:53,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:53,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:53,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:53,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:53,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:53,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:53,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:53,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:53,519 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45899,1689325949913' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-14 09:14:53,519 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b43fad9[Count = 0] remaining members to acquire global barrier 2023-07-14 09:14:53,519 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-14 09:14:53,519 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,521 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,521 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,521 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,521 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-14 09:14:53,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,522 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-14 09:14:53,522 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:53,522 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:53,522 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 09:14:53,523 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-14 09:14:53,523 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-14 09:14:53,523 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,41875,1689325950034' in zk 2023-07-14 09:14:53,526 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-14 09:14:53,526 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:53,526 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-14 09:14:53,529 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 09:14:53,529 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 09:14:53,532 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 09:14:53,532 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689326091972.be9d9f0b1b469b1e32dacb84e7be0125. 2023-07-14 09:14:53,532 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 09:14:53,533 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689326091972.be9d9f0b1b469b1e32dacb84e7be0125. started... 2023-07-14 09:14:53,533 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689326091972.2355ebf4f35b8719688862eecc662ae6. 2023-07-14 09:14:53,533 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689326091972.2355ebf4f35b8719688862eecc662ae6. started... 2023-07-14 09:14:53,535 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for be9d9f0b1b469b1e32dacb84e7be0125: 2023-07-14 09:14:53,536 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2355ebf4f35b8719688862eecc662ae6: 2023-07-14 09:14:53,536 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689326091972.be9d9f0b1b469b1e32dacb84e7be0125.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,536 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689326091972.2355ebf4f35b8719688862eecc662ae6.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,536 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 09:14:53,536 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 09:14:53,536 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 09:14:53,537 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 09:14:53,669 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:14:53,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 09:14:53,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:14:53,671 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 09:14:53,673 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689326091972.be9d9f0b1b469b1e32dacb84e7be0125. completed. 2023-07-14 09:14:53,673 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689326091972.be9d9f0b1b469b1e32dacb84e7be0125. 2023-07-14 09:14:53,673 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 09:14:53,673 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 09:14:53,673 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:53,673 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-14 09:14:53,673 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,37313,1689325949765' in zk 2023-07-14 09:14:53,675 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:53,675 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-14 09:14:53,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:53,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:53,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:53,675 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:53,675 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689326091972.2355ebf4f35b8719688862eecc662ae6. completed. 2023-07-14 09:14:53,676 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689326091972.2355ebf4f35b8719688862eecc662ae6. 2023-07-14 09:14:53,676 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-14 09:14:53,676 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 09:14:53,676 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 09:14:53,676 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:53,676 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-14 09:14:53,676 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,45899,1689325949913' in zk 2023-07-14 09:14:53,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:53,683 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-14 09:14:53,683 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:53,683 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:53,683 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-14 09:14:53,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:53,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:53,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:53,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:53,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:53,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:53,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:53,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:53,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,37313,1689325949765': 2023-07-14 09:14:53,689 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,37313,1689325949765' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-14 09:14:53,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:53,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:53,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:53,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:53,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:53,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:53,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:53,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:53,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:53,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:53,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:53,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:53,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,45899,1689325949913': 2023-07-14 09:14:53,695 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45899,1689325949913' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-14 09:14:53,695 INFO [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-14 09:14:53,695 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 09:14:53,695 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 09:14:53,695 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,695 INFO [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 09:14:53,705 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,705 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:53,705 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,705 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,705 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:53,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,706 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,705 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:53,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:53,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:53,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:53,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:53,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:53,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:53,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:53,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:53,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:53,709 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:53,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,710 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:53,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:53,711 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:53,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:53,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:53,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:53,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:53,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,717 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:53,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:53,717 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:53,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:53,718 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:53,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:53,722 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:53,722 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:53,722 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:53,722 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:53,722 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,722 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:53,722 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:53,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:53,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:53,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:53,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:53,722 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:53,724 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:53,724 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:53,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:53,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:53,722 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,724 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,725 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,725 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-14 09:14:53,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:53,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:53,725 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-14 09:14:53,722 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:53,729 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,729 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:53,729 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,729 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:53,729 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:53,729 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,729 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:53,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:53,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:53,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:53,752 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,753 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,818 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,867 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-14 09:14:53,867 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,867 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,868 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689326093342Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689326093752 (+410 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689326093752Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689326093752Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689326093792 (+40 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689326093811 (+19 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689326093867 (+56 ms) 2023-07-14 09:14:53,877 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-14 09:14:53,879 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 535 msec 2023-07-14 09:14:53,971 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:14:53,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 09:14:53,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 09:14:53,974 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45899] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689326091972.2355ebf4f35b8719688862eecc662ae6. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 09:14:53,976 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37313] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689326091972.be9d9f0b1b469b1e32dacb84e7be0125. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 09:14:53,979 DEBUG [Listener at jenkins-hbase9.apache.org/45395] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:53,980 DEBUG [Listener at jenkins-hbase9.apache.org/45395] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689326091972.2355ebf4f35b8719688862eecc662ae6. 2023-07-14 09:14:53,980 INFO [Listener at jenkins-hbase9.apache.org/45395] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 09:14:53,989 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-14 09:14:53,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689326093989 (current time:1689326093989). 2023-07-14 09:14:53,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 09:14:53,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] zookeeper.ReadOnlyZKClient(139): Connect 0x0c793fba to 127.0.0.1:59920 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:14:53,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8e03144, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:14:53,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:14:54,000 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:51986, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:14:54,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0c793fba to 127.0.0.1:59920 2023-07-14 09:14:54,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:14:54,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] zookeeper.ReadOnlyZKClient(139): Connect 0x729ba29a to 127.0.0.1:59920 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:14:54,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@375ad79c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:14:54,026 DEBUG [hconnection-0x3e39ba22-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:14:54,031 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:51996, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:14:54,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:14:54,046 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:53352, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:14:54,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x729ba29a to 127.0.0.1:59920 2023-07-14 09:14:54,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:14:54,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-14 09:14:54,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 09:14:54,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-14 09:14:54,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-14 09:14:54,075 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-14 09:14:54,078 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689326694078 2023-07-14 09:14:54,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-14 09:14:54,086 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,088 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 09:14:54,088 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 09:14:54,090 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-14 09:14:54,091 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-14 09:14:54,092 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 38 msec 2023-07-14 09:14:54,094 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-14 09:14:54,094 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689326694094 2023-07-14 09:14:54,141 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,142 INFO [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-14 09:14:54,142 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:54,145 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-14 09:14:54,145 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-14 09:14:54,145 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,145 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,148 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:54,148 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:54,148 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:54,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:54,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:54,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:54,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:54,148 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:54,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:54,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:54,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,149 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:54,149 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:54,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,149 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,149 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,149 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,149 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:54,150 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 09:14:54,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-14 09:14:54,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-14 09:14:54,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-14 09:14:54,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,150 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-14 09:14:54,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,150 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-14 09:14:54,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,151 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-14 09:14:54,152 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,152 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-14 09:14:54,152 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:54,153 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,157 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-14 09:14:54,157 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:54,157 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,159 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-14 09:14:54,159 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-14 09:14:54,159 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,37313,1689325949765' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-14 09:14:54,160 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-14 09:14:54,160 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:54,163 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,163 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:54,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:54,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:54,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:54,163 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,163 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:14:54,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:54,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:54,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:54,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:54,166 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-14 09:14:54,166 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-14 09:14:54,166 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41875,1689325950034' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-14 09:14:54,166 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-14 09:14:54,166 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-14 09:14:54,166 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45899,1689325949913' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-14 09:14:54,167 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,168 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:54,168 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,168 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:14:54,166 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,37313,1689325949765' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-14 09:14:54,168 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,173 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b8a8e91[Count = 1] remaining members to acquire global barrier 2023-07-14 09:14:54,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:54,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:54,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:54,173 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,173 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:14:54,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:54,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:54,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:54,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:54,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:54,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:54,181 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45899,1689325949913' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-14 09:14:54,181 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b8a8e91[Count = 0] remaining members to acquire global barrier 2023-07-14 09:14:54,181 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-14 09:14:54,181 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,188 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,188 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,188 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,188 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-14 09:14:54,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,188 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-14 09:14:54,188 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:54,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,188 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:14:54,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,188 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 09:14:54,189 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 09:14:54,189 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-14 09:14:54,189 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 09:14:54,189 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:54,189 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 09:14:54,189 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-14 09:14:54,189 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689326091972.2355ebf4f35b8719688862eecc662ae6. 2023-07-14 09:14:54,189 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,41875,1689325950034' in zk 2023-07-14 09:14:54,189 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 09:14:54,189 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689326091972.2355ebf4f35b8719688862eecc662ae6. started... 2023-07-14 09:14:54,189 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689326091972.be9d9f0b1b469b1e32dacb84e7be0125. 2023-07-14 09:14:54,189 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689326091972.be9d9f0b1b469b1e32dacb84e7be0125. started... 2023-07-14 09:14:54,189 INFO [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2355ebf4f35b8719688862eecc662ae6 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-14 09:14:54,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 09:14:54,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:14:54,189 INFO [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] regionserver.HRegion(2745): Flushing be9d9f0b1b469b1e32dacb84e7be0125 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-14 09:14:54,191 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 09:14:54,192 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-14 09:14:54,192 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:54,192 DEBUG [member: 'jenkins-hbase9.apache.org,41875,1689325950034' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-14 09:14:54,286 INFO [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071488f71b0025e248d79a2a4886fa9a098f to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023071488f71b0025e248d79a2a4886fa9a098f 2023-07-14 09:14:54,299 INFO [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230714caa2151883204dacb5ab53a61648efcd to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230714caa2151883204dacb5ab53a61648efcd 2023-07-14 09:14:54,356 INFO [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithSkipTmp/be9d9f0b1b469b1e32dacb84e7be0125/.tmp/cf/f0b1ad266a0943c69b32e5026ec92b82 2023-07-14 09:14:54,365 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithSkipTmp/be9d9f0b1b469b1e32dacb84e7be0125/.tmp/cf/f0b1ad266a0943c69b32e5026ec92b82 as hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithSkipTmp/be9d9f0b1b469b1e32dacb84e7be0125/cf/f0b1ad266a0943c69b32e5026ec92b82 2023-07-14 09:14:54,365 INFO [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithSkipTmp/2355ebf4f35b8719688862eecc662ae6/.tmp/cf/b5eb62222eef49ffb164eea3a6c5fbdb 2023-07-14 09:14:54,373 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithSkipTmp/2355ebf4f35b8719688862eecc662ae6/.tmp/cf/b5eb62222eef49ffb164eea3a6c5fbdb as hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithSkipTmp/2355ebf4f35b8719688862eecc662ae6/cf/b5eb62222eef49ffb164eea3a6c5fbdb 2023-07-14 09:14:54,375 INFO [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithSkipTmp/be9d9f0b1b469b1e32dacb84e7be0125/cf/f0b1ad266a0943c69b32e5026ec92b82, entries=47, sequenceid=6, filesize=13.3 K 2023-07-14 09:14:54,381 INFO [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for be9d9f0b1b469b1e32dacb84e7be0125 in 192ms, sequenceid=6, compaction requested=false 2023-07-14 09:14:54,381 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-14 09:14:54,382 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for be9d9f0b1b469b1e32dacb84e7be0125: 2023-07-14 09:14:54,382 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689326091972.be9d9f0b1b469b1e32dacb84e7be0125.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,382 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 09:14:54,382 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithSkipTmp/be9d9f0b1b469b1e32dacb84e7be0125/cf/f0b1ad266a0943c69b32e5026ec92b82] hfiles 2023-07-14 09:14:54,382 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithSkipTmp/be9d9f0b1b469b1e32dacb84e7be0125/cf/f0b1ad266a0943c69b32e5026ec92b82 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,391 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:14:54,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 09:14:54,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:14:54,393 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 09:14:54,407 INFO [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithSkipTmp/2355ebf4f35b8719688862eecc662ae6/cf/b5eb62222eef49ffb164eea3a6c5fbdb, entries=3, sequenceid=6, filesize=5.4 K 2023-07-14 09:14:54,410 INFO [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 2355ebf4f35b8719688862eecc662ae6 in 221ms, sequenceid=6, compaction requested=false 2023-07-14 09:14:54,443 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2355ebf4f35b8719688862eecc662ae6: 2023-07-14 09:14:54,443 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689326091972.2355ebf4f35b8719688862eecc662ae6.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,444 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 09:14:54,444 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithSkipTmp/2355ebf4f35b8719688862eecc662ae6/cf/b5eb62222eef49ffb164eea3a6c5fbdb] hfiles 2023-07-14 09:14:54,444 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithSkipTmp/2355ebf4f35b8719688862eecc662ae6/cf/b5eb62222eef49ffb164eea3a6c5fbdb for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,544 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689326091972.2355ebf4f35b8719688862eecc662ae6. completed. 2023-07-14 09:14:54,544 DEBUG [rs(jenkins-hbase9.apache.org,45899,1689325949913)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689326091972.2355ebf4f35b8719688862eecc662ae6. 2023-07-14 09:14:54,544 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 09:14:54,544 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 09:14:54,544 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:54,544 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-14 09:14:54,544 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,45899,1689325949913' in zk 2023-07-14 09:14:54,548 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-14 09:14:54,548 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:54,548 DEBUG [member: 'jenkins-hbase9.apache.org,45899,1689325949913' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-14 09:14:54,548 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:54,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:54,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:54,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:54,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:54,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:54,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:54,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:54,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:54,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:54,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:54,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:54,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,45899,1689325949913': 2023-07-14 09:14:54,559 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45899,1689325949913' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-14 09:14:54,693 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:14:54,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 09:14:54,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:14:54,695 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-14 09:14:54,924 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689326091972.be9d9f0b1b469b1e32dacb84e7be0125. completed. 2023-07-14 09:14:54,924 DEBUG [rs(jenkins-hbase9.apache.org,37313,1689325949765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689326091972.be9d9f0b1b469b1e32dacb84e7be0125. 2023-07-14 09:14:54,924 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 09:14:54,925 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 09:14:54,925 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:54,925 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-14 09:14:54,925 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,37313,1689325949765' in zk 2023-07-14 09:14:54,927 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:54,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:54,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:54,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:54,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:54,928 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-14 09:14:54,928 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:54,928 DEBUG [member: 'jenkins-hbase9.apache.org,37313,1689325949765' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-14 09:14:54,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:54,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:54,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:54,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:54,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:54,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:54,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:54,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:54,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,37313,1689325949765': 2023-07-14 09:14:54,935 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,37313,1689325949765' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-14 09:14:54,935 INFO [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-14 09:14:54,935 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 09:14:54,935 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 09:14:54,935 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,936 INFO [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 09:14:54,938 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,938 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,938 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:54,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:54,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:54,939 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,939 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:54,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,939 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,939 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:54,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:54,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:54,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:54,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:54,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:54,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:54,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:54,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,941 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:54,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:54,943 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:54,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,943 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:54,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:54,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:54,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:54,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:54,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:54,948 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:54,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:54,948 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:54,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:54,949 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:54,953 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:54,953 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:54,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:54,953 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:54,953 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:54,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:54,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:54,953 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:54,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:54,953 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:54,953 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,953 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,953 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:54,953 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,954 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-14 09:14:54,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:54,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:54,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:54,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:54,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:54,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:54,953 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,954 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:54,954 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:54,954 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,954 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:14:54,954 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,954 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:14:54,954 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:14:54,954 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,954 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:54,955 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230714caa2151883204dacb5ab53a61648efcd, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023071488f71b0025e248d79a2a4886fa9a098f] mob files 2023-07-14 09:14:54,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:54,953 DEBUG [(jenkins-hbase9.apache.org,41733,1689325948012)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:54,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:54,955 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230714caa2151883204dacb5ab53a61648efcd 2023-07-14 09:14:54,956 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023071488f71b0025e248d79a2a4886fa9a098f 2023-07-14 09:14:55,025 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:55,025 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:55,135 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:55,189 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-14 09:14:55,190 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:55,190 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:55,190 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689326094086Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689326095024 (+938 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689326095025 (+1 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689326095025Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689326095051 (+26 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689326095099 (+48 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689326095189 (+90 ms) 2023-07-14 09:14:55,193 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-14 09:14:55,195 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 1.1060 sec 2023-07-14 09:14:55,195 DEBUG [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:14:55,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 09:14:55,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 09:14:55,197 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/export-test/export-1689326095197 2023-07-14 09:14:55,197 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43771, tgtDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/export-test/export-1689326095197, rawTgtDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/export-test/export-1689326095197, srcFsUri=hdfs://localhost:43771, srcDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8 2023-07-14 09:14:55,236 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43771, inputRoot=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8 2023-07-14 09:14:55,236 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_471043129_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/export-test/export-1689326095197, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/export-test/export-1689326095197/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:55,236 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43771, inputRoot=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8, snapshotDir=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-14 09:14:55,263 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/export-test/export-1689326095197/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:55,334 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:55,334 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:55,335 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:55,335 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:55,336 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:55,336 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:55,337 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:55,462 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/hadoop-4230141840304579402.jar 2023-07-14 09:14:55,463 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:55,463 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:55,464 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:55,464 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:55,465 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:55,465 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:55,466 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 09:14:55,466 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 09:14:55,467 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 09:14:55,468 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 09:14:55,468 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 09:14:55,469 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 09:14:55,469 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 09:14:55,470 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 09:14:55,470 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 09:14:55,471 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 09:14:55,472 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:14:55,472 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:14:55,473 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 09:14:55,473 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:14:55,473 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:14:55,474 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 09:14:55,474 DEBUG [Listener at jenkins-hbase9.apache.org/45395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 09:14:56,074 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960675_0006_000001 (auth:SIMPLE) 2023-07-14 09:14:56,999 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 09:14:57,931 WARN [Listener at jenkins-hbase9.apache.org/45395] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 09:14:57,934 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-14 09:14:57,937 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-14 09:14:58,033 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 09:14:58,035 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 09:14:58,068 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960675_0007_000001 (auth:SIMPLE) 2023-07-14 09:15:04,903 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960675_0007_000001 (auth:SIMPLE) 2023-07-14 09:15:07,241 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960675_0007_000001 (auth:SIMPLE) 2023-07-14 09:15:10,460 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960675_0007_000001 (auth:SIMPLE) 2023-07-14 09:15:12,256 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 09:15:12,256 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 09:15:12,266 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:15:12,266 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 09:15:12,267 INFO [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 09:15:12,267 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2112291524_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:15:12,268 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(367): hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-14 09:15:12,268 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(367): hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-14 09:15:12,268 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2112291524_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/export-test/export-1689326095197/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/export-test/export-1689326095197/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:15:12,268 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(367): hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/export-test/export-1689326095197/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-14 09:15:12,269 DEBUG [Listener at jenkins-hbase9.apache.org/45395] snapshot.TestExportSnapshot(367): hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/export-test/export-1689326095197/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-14 09:15:12,275 INFO [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 09:15:12,275 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 09:15:12,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 09:15:12,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-14 09:15:12,280 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689326112280"}]},"ts":"1689326112280"} 2023-07-14 09:15:12,281 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-14 09:15:12,283 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-14 09:15:12,283 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2355ebf4f35b8719688862eecc662ae6, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=be9d9f0b1b469b1e32dacb84e7be0125, UNASSIGN}] 2023-07-14 09:15:12,285 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2355ebf4f35b8719688862eecc662ae6, UNASSIGN 2023-07-14 09:15:12,285 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=be9d9f0b1b469b1e32dacb84e7be0125, UNASSIGN 2023-07-14 09:15:12,286 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=2355ebf4f35b8719688862eecc662ae6, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:15:12,286 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=be9d9f0b1b469b1e32dacb84e7be0125, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:15:12,286 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689326091972.2355ebf4f35b8719688862eecc662ae6.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689326112285"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689326112285"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689326112285"}]},"ts":"1689326112285"} 2023-07-14 09:15:12,286 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689326091972.be9d9f0b1b469b1e32dacb84e7be0125.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689326112285"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689326112285"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689326112285"}]},"ts":"1689326112285"} 2023-07-14 09:15:12,287 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 2355ebf4f35b8719688862eecc662ae6, server=jenkins-hbase9.apache.org,45899,1689325949913}] 2023-07-14 09:15:12,288 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure be9d9f0b1b469b1e32dacb84e7be0125, server=jenkins-hbase9.apache.org,37313,1689325949765}] 2023-07-14 09:15:12,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-14 09:15:12,439 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 2355ebf4f35b8719688862eecc662ae6 2023-07-14 09:15:12,439 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close be9d9f0b1b469b1e32dacb84e7be0125 2023-07-14 09:15:12,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 2355ebf4f35b8719688862eecc662ae6, disabling compactions & flushes 2023-07-14 09:15:12,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing be9d9f0b1b469b1e32dacb84e7be0125, disabling compactions & flushes 2023-07-14 09:15:12,439 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689326091972.2355ebf4f35b8719688862eecc662ae6. 2023-07-14 09:15:12,439 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689326091972.be9d9f0b1b469b1e32dacb84e7be0125. 2023-07-14 09:15:12,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689326091972.2355ebf4f35b8719688862eecc662ae6. 2023-07-14 09:15:12,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689326091972.be9d9f0b1b469b1e32dacb84e7be0125. 2023-07-14 09:15:12,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689326091972.be9d9f0b1b469b1e32dacb84e7be0125. after waiting 0 ms 2023-07-14 09:15:12,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689326091972.2355ebf4f35b8719688862eecc662ae6. after waiting 0 ms 2023-07-14 09:15:12,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689326091972.be9d9f0b1b469b1e32dacb84e7be0125. 2023-07-14 09:15:12,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689326091972.2355ebf4f35b8719688862eecc662ae6. 2023-07-14 09:15:12,448 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithSkipTmp/be9d9f0b1b469b1e32dacb84e7be0125/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 09:15:12,448 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/default/testtb-testExportFileSystemStateWithSkipTmp/2355ebf4f35b8719688862eecc662ae6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 09:15:12,448 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 09:15:12,448 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 09:15:12,449 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689326091972.be9d9f0b1b469b1e32dacb84e7be0125. 2023-07-14 09:15:12,450 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for be9d9f0b1b469b1e32dacb84e7be0125: 2023-07-14 09:15:12,450 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689326091972.2355ebf4f35b8719688862eecc662ae6. 2023-07-14 09:15:12,450 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 2355ebf4f35b8719688862eecc662ae6: 2023-07-14 09:15:12,452 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 2355ebf4f35b8719688862eecc662ae6 2023-07-14 09:15:12,452 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=2355ebf4f35b8719688862eecc662ae6, regionState=CLOSED 2023-07-14 09:15:12,453 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689326091972.2355ebf4f35b8719688862eecc662ae6.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689326112452"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689326112452"}]},"ts":"1689326112452"} 2023-07-14 09:15:12,453 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed be9d9f0b1b469b1e32dacb84e7be0125 2023-07-14 09:15:12,453 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=be9d9f0b1b469b1e32dacb84e7be0125, regionState=CLOSED 2023-07-14 09:15:12,453 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689326091972.be9d9f0b1b469b1e32dacb84e7be0125.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689326112453"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689326112453"}]},"ts":"1689326112453"} 2023-07-14 09:15:12,465 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-14 09:15:12,465 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 2355ebf4f35b8719688862eecc662ae6, server=jenkins-hbase9.apache.org,45899,1689325949913 in 167 msec 2023-07-14 09:15:12,466 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-14 09:15:12,466 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure be9d9f0b1b469b1e32dacb84e7be0125, server=jenkins-hbase9.apache.org,37313,1689325949765 in 168 msec 2023-07-14 09:15:12,468 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2355ebf4f35b8719688862eecc662ae6, UNASSIGN in 182 msec 2023-07-14 09:15:12,469 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-14 09:15:12,469 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=be9d9f0b1b469b1e32dacb84e7be0125, UNASSIGN in 183 msec 2023-07-14 09:15:12,470 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689326112470"}]},"ts":"1689326112470"} 2023-07-14 09:15:12,471 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-14 09:15:12,473 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-14 09:15:12,474 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 197 msec 2023-07-14 09:15:12,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-14 09:15:12,583 INFO [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-14 09:15:12,584 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 09:15:12,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 09:15:12,588 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 09:15:12,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 09:15:12,589 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 09:15:12,590 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41875] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 09:15:12,595 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2355ebf4f35b8719688862eecc662ae6 2023-07-14 09:15:12,595 DEBUG [HFileArchiver-24] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/be9d9f0b1b469b1e32dacb84e7be0125 2023-07-14 09:15:12,597 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 09:15:12,597 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 09:15:12,597 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 09:15:12,598 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 09:15:12,598 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-14 09:15:12,598 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-14 09:15:12,598 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-14 09:15:12,599 DEBUG [HFileArchiver-24] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/be9d9f0b1b469b1e32dacb84e7be0125/cf, FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/be9d9f0b1b469b1e32dacb84e7be0125/recovered.edits] 2023-07-14 09:15:12,600 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2355ebf4f35b8719688862eecc662ae6/cf, FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2355ebf4f35b8719688862eecc662ae6/recovered.edits] 2023-07-14 09:15:12,600 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:15:12,600 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 09:15:12,600 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:15:12,601 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 09:15:12,601 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:15:12,601 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 09:15:12,601 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:15:12,604 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-07-14 09:15:12,604 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-14 09:15:12,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-14 09:15:12,610 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2355ebf4f35b8719688862eecc662ae6/cf/b5eb62222eef49ffb164eea3a6c5fbdb to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/2355ebf4f35b8719688862eecc662ae6/cf/b5eb62222eef49ffb164eea3a6c5fbdb 2023-07-14 09:15:12,614 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2355ebf4f35b8719688862eecc662ae6/recovered.edits/9.seqid to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/2355ebf4f35b8719688862eecc662ae6/recovered.edits/9.seqid 2023-07-14 09:15:12,617 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2355ebf4f35b8719688862eecc662ae6 2023-07-14 09:15:12,621 DEBUG [HFileArchiver-24] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/be9d9f0b1b469b1e32dacb84e7be0125/cf/f0b1ad266a0943c69b32e5026ec92b82 to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/be9d9f0b1b469b1e32dacb84e7be0125/cf/f0b1ad266a0943c69b32e5026ec92b82 2023-07-14 09:15:12,624 DEBUG [HFileArchiver-24] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/be9d9f0b1b469b1e32dacb84e7be0125/recovered.edits/9.seqid to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/be9d9f0b1b469b1e32dacb84e7be0125/recovered.edits/9.seqid 2023-07-14 09:15:12,625 DEBUG [HFileArchiver-24] backup.HFileArchiver(596): Deleted hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/be9d9f0b1b469b1e32dacb84e7be0125 2023-07-14 09:15:12,625 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-14 09:15:12,625 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-14 09:15:12,626 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-14 09:15:12,629 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230714caa2151883204dacb5ab53a61648efcd to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230714caa2151883204dacb5ab53a61648efcd 2023-07-14 09:15:12,630 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023071488f71b0025e248d79a2a4886fa9a098f to hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023071488f71b0025e248d79a2a4886fa9a098f 2023-07-14 09:15:12,631 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-14 09:15:12,633 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 09:15:12,635 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-14 09:15:12,639 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-14 09:15:12,640 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 09:15:12,640 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-14 09:15:12,640 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689326091972.2355ebf4f35b8719688862eecc662ae6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689326112640"}]},"ts":"9223372036854775807"} 2023-07-14 09:15:12,641 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689326091972.be9d9f0b1b469b1e32dacb84e7be0125.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689326112640"}]},"ts":"9223372036854775807"} 2023-07-14 09:15:12,642 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 09:15:12,642 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 2355ebf4f35b8719688862eecc662ae6, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689326091972.2355ebf4f35b8719688862eecc662ae6.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => be9d9f0b1b469b1e32dacb84e7be0125, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689326091972.be9d9f0b1b469b1e32dacb84e7be0125.', STARTKEY => '1', ENDKEY => ''}] 2023-07-14 09:15:12,642 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-14 09:15:12,642 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689326112642"}]},"ts":"9223372036854775807"} 2023-07-14 09:15:12,648 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-14 09:15:12,650 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 09:15:12,651 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 66 msec 2023-07-14 09:15:12,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-14 09:15:12,707 INFO [Listener at jenkins-hbase9.apache.org/45395] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-14 09:15:12,716 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-14 09:15:12,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:15:12,719 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-14 09:15:12,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41733] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:15:12,745 INFO [Listener at jenkins-hbase9.apache.org/45395] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=757 (was 758), OpenFileDescriptor=902 (was 904), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1018 (was 1050), ProcessCount=184 (was 187), AvailableMemoryMB=1943 (was 2395) 2023-07-14 09:15:12,745 WARN [Listener at jenkins-hbase9.apache.org/45395] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-07-14 09:15:12,745 INFO [Listener at jenkins-hbase9.apache.org/45395] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-14 09:15:12,755 INFO [Listener at jenkins-hbase9.apache.org/45395] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-07-14 09:15:16,596 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960675_0007_000001 (auth:SIMPLE) 2023-07-14 09:15:18,105 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 09:15:26,956 INFO [Listener at jenkins-hbase9.apache.org/45395] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-07-14 09:15:41,122 ERROR [Thread[Thread-411,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-14 09:15:41,123 INFO [Listener at jenkins-hbase9.apache.org/45395] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-07-14 09:15:41,241 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-14 09:15:41,266 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-14 09:15:41,267 ERROR [Thread[Thread-421,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-14 09:15:41,328 INFO [Listener at jenkins-hbase9.apache.org/45395] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-07-14 09:15:41,432 ERROR [Thread[Thread-385,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-14 09:15:41,432 INFO [Listener at jenkins-hbase9.apache.org/45395] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-14 09:15:41,432 INFO [Listener at jenkins-hbase9.apache.org/45395] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-14 09:15:41,433 INFO [Listener at jenkins-hbase9.apache.org/45395] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-14 09:15:41,433 DEBUG [Listener at jenkins-hbase9.apache.org/45395] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x32306b66 to 127.0.0.1:59920 2023-07-14 09:15:41,433 DEBUG [Listener at jenkins-hbase9.apache.org/45395] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:15:41,433 DEBUG [Listener at jenkins-hbase9.apache.org/45395] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-14 09:15:41,433 DEBUG [Listener at jenkins-hbase9.apache.org/45395] util.JVMClusterUtil(257): Found active master hash=1010112837, stopped=false 2023-07-14 09:15:41,433 DEBUG [Listener at jenkins-hbase9.apache.org/45395] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 09:15:41,434 DEBUG [Listener at jenkins-hbase9.apache.org/45395] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-14 09:15:41,434 INFO [Listener at jenkins-hbase9.apache.org/45395] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase9.apache.org,41733,1689325948012 2023-07-14 09:15:41,437 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-14 09:15:41,437 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-14 09:15:41,437 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 09:15:41,438 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-14 09:15:41,438 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-14 09:15:41,438 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 09:15:41,438 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 09:15:41,438 INFO [Listener at jenkins-hbase9.apache.org/45395] procedure2.ProcedureExecutor(629): Stopping 2023-07-14 09:15:41,439 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 09:15:41,439 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 09:15:41,440 DEBUG [Listener at jenkins-hbase9.apache.org/45395] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x195ec3e9 to 127.0.0.1:59920 2023-07-14 09:15:41,440 DEBUG [Listener at jenkins-hbase9.apache.org/45395] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:15:41,440 INFO [Listener at jenkins-hbase9.apache.org/45395] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,37313,1689325949765' ***** 2023-07-14 09:15:41,440 DEBUG [Listener at jenkins-hbase9.apache.org/45395] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 09:15:41,440 INFO [Listener at jenkins-hbase9.apache.org/45395] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-14 09:15:41,440 INFO [Listener at jenkins-hbase9.apache.org/45395] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,45899,1689325949913' ***** 2023-07-14 09:15:41,441 DEBUG [Listener at jenkins-hbase9.apache.org/45395] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 09:15:41,441 INFO [Listener at jenkins-hbase9.apache.org/45395] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-14 09:15:41,441 INFO [Listener at jenkins-hbase9.apache.org/45395] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,41875,1689325950034' ***** 2023-07-14 09:15:41,441 DEBUG [Listener at jenkins-hbase9.apache.org/45395] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 09:15:41,441 INFO [RS:0;jenkins-hbase9:37313] regionserver.HeapMemoryManager(220): Stopping 2023-07-14 09:15:41,441 INFO [Listener at jenkins-hbase9.apache.org/45395] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-14 09:15:41,441 INFO [RS:0;jenkins-hbase9:37313] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-14 09:15:41,441 INFO [RS:0;jenkins-hbase9:37313] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-14 09:15:41,441 INFO [RS:1;jenkins-hbase9:45899] regionserver.HeapMemoryManager(220): Stopping 2023-07-14 09:15:41,441 INFO [RS:1;jenkins-hbase9:45899] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-14 09:15:41,442 INFO [RS:1;jenkins-hbase9:45899] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-14 09:15:41,442 INFO [RS:1;jenkins-hbase9:45899] regionserver.HRegionServer(3305): Received CLOSE for a31c75d31bc38f2da6b8ff6a09c13ed8 2023-07-14 09:15:41,442 INFO [RS:1;jenkins-hbase9:45899] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:15:41,442 DEBUG [RS:1;jenkins-hbase9:45899] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0babf758 to 127.0.0.1:59920 2023-07-14 09:15:41,442 DEBUG [RS:1;jenkins-hbase9:45899] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:15:41,441 INFO [RS:0;jenkins-hbase9:37313] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:15:41,446 DEBUG [RS:0;jenkins-hbase9:37313] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2c8bbae5 to 127.0.0.1:59920 2023-07-14 09:15:41,441 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-14 09:15:41,450 DEBUG [RS:0;jenkins-hbase9:37313] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:15:41,449 INFO [RS:1;jenkins-hbase9:45899] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-14 09:15:41,450 INFO [RS:1;jenkins-hbase9:45899] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-14 09:15:41,451 INFO [RS:1;jenkins-hbase9:45899] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-14 09:15:41,451 INFO [RS:1;jenkins-hbase9:45899] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-14 09:15:41,449 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-14 09:15:41,448 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-14 09:15:41,445 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing a31c75d31bc38f2da6b8ff6a09c13ed8, disabling compactions & flushes 2023-07-14 09:15:41,441 INFO [RS:2;jenkins-hbase9:41875] regionserver.HeapMemoryManager(220): Stopping 2023-07-14 09:15:41,451 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689325953785.a31c75d31bc38f2da6b8ff6a09c13ed8. 2023-07-14 09:15:41,451 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689325953785.a31c75d31bc38f2da6b8ff6a09c13ed8. 2023-07-14 09:15:41,451 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689325953785.a31c75d31bc38f2da6b8ff6a09c13ed8. after waiting 0 ms 2023-07-14 09:15:41,451 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689325953785.a31c75d31bc38f2da6b8ff6a09c13ed8. 2023-07-14 09:15:41,451 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing a31c75d31bc38f2da6b8ff6a09c13ed8 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-14 09:15:41,454 INFO [RS:0;jenkins-hbase9:37313] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,37313,1689325949765; all regions closed. 2023-07-14 09:15:41,457 INFO [RS:1;jenkins-hbase9:45899] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-14 09:15:41,458 INFO [RS:2;jenkins-hbase9:41875] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-14 09:15:41,458 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-14 09:15:41,458 INFO [RS:2;jenkins-hbase9:41875] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-14 09:15:41,459 INFO [RS:2;jenkins-hbase9:41875] regionserver.HRegionServer(3305): Received CLOSE for 2f3365ac32cf3617812342edf7d92305 2023-07-14 09:15:41,459 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-14 09:15:41,459 INFO [RS:2;jenkins-hbase9:41875] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:15:41,459 DEBUG [RS:2;jenkins-hbase9:41875] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x52052cea to 127.0.0.1:59920 2023-07-14 09:15:41,459 DEBUG [RS:1;jenkins-hbase9:45899] regionserver.HRegionServer(1478): Online Regions={a31c75d31bc38f2da6b8ff6a09c13ed8=hbase:namespace,,1689325953785.a31c75d31bc38f2da6b8ff6a09c13ed8., 1588230740=hbase:meta,,1.1588230740} 2023-07-14 09:15:41,459 DEBUG [RS:2;jenkins-hbase9:41875] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:15:41,462 DEBUG [RS:1;jenkins-hbase9:45899] regionserver.HRegionServer(1504): Waiting on 1588230740, a31c75d31bc38f2da6b8ff6a09c13ed8 2023-07-14 09:15:41,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 2f3365ac32cf3617812342edf7d92305, disabling compactions & flushes 2023-07-14 09:15:41,466 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689325954708.2f3365ac32cf3617812342edf7d92305. 2023-07-14 09:15:41,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689325954708.2f3365ac32cf3617812342edf7d92305. 2023-07-14 09:15:41,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689325954708.2f3365ac32cf3617812342edf7d92305. after waiting 0 ms 2023-07-14 09:15:41,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689325954708.2f3365ac32cf3617812342edf7d92305. 2023-07-14 09:15:41,467 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 2f3365ac32cf3617812342edf7d92305 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-14 09:15:41,468 INFO [RS:2;jenkins-hbase9:41875] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-14 09:15:41,468 DEBUG [RS:2;jenkins-hbase9:41875] regionserver.HRegionServer(1478): Online Regions={2f3365ac32cf3617812342edf7d92305=hbase:acl,,1689325954708.2f3365ac32cf3617812342edf7d92305.} 2023-07-14 09:15:41,468 DEBUG [RS:2;jenkins-hbase9:41875] regionserver.HRegionServer(1504): Waiting on 2f3365ac32cf3617812342edf7d92305 2023-07-14 09:15:41,492 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-14 09:15:41,492 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-14 09:15:41,492 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-14 09:15:41,492 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-14 09:15:41,492 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-14 09:15:41,499 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-14 09:15:41,531 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-14 09:15:41,548 DEBUG [RS:0;jenkins-hbase9:37313] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/oldWALs 2023-07-14 09:15:41,548 INFO [RS:0;jenkins-hbase9:37313] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C37313%2C1689325949765:(num 1689325952923) 2023-07-14 09:15:41,548 DEBUG [RS:0;jenkins-hbase9:37313] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:15:41,548 INFO [RS:0;jenkins-hbase9:37313] regionserver.LeaseManager(133): Closed leases 2023-07-14 09:15:41,554 INFO [RS:0;jenkins-hbase9:37313] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-14 09:15:41,555 INFO [RS:0;jenkins-hbase9:37313] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-14 09:15:41,555 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-14 09:15:41,555 INFO [RS:0;jenkins-hbase9:37313] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-14 09:15:41,555 INFO [RS:0;jenkins-hbase9:37313] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-14 09:15:41,592 INFO [RS:0;jenkins-hbase9:37313] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:37313 2023-07-14 09:15:41,598 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:15:41,598 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:15:41,598 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 09:15:41,599 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,37313,1689325949765 2023-07-14 09:15:41,599 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 09:15:41,598 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 09:15:41,598 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 09:15:41,606 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,37313,1689325949765] 2023-07-14 09:15:41,607 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,37313,1689325949765; numProcessing=1 2023-07-14 09:15:41,609 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,37313,1689325949765 already deleted, retry=false 2023-07-14 09:15:41,609 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,37313,1689325949765 expired; onlineServers=2 2023-07-14 09:15:41,610 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/hbase/meta/1588230740/.tmp/info/bdae23f3f80d407db426508bf5082615 2023-07-14 09:15:41,626 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/hbase/acl/2f3365ac32cf3617812342edf7d92305/.tmp/l/d51a9f2633f049b8a091ab82437db4bb 2023-07-14 09:15:41,628 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-14 09:15:41,629 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-14 09:15:41,630 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bdae23f3f80d407db426508bf5082615 2023-07-14 09:15:41,633 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d51a9f2633f049b8a091ab82437db4bb 2023-07-14 09:15:41,635 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/hbase/acl/2f3365ac32cf3617812342edf7d92305/.tmp/l/d51a9f2633f049b8a091ab82437db4bb as hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/hbase/acl/2f3365ac32cf3617812342edf7d92305/l/d51a9f2633f049b8a091ab82437db4bb 2023-07-14 09:15:41,650 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d51a9f2633f049b8a091ab82437db4bb 2023-07-14 09:15:41,650 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/hbase/acl/2f3365ac32cf3617812342edf7d92305/l/d51a9f2633f049b8a091ab82437db4bb, entries=7, sequenceid=18, filesize=5.2 K 2023-07-14 09:15:41,652 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 2f3365ac32cf3617812342edf7d92305 in 185ms, sequenceid=18, compaction requested=false 2023-07-14 09:15:41,670 DEBUG [RS:2;jenkins-hbase9:41875] regionserver.HRegionServer(1504): Waiting on 2f3365ac32cf3617812342edf7d92305 2023-07-14 09:15:41,678 DEBUG [RS:1;jenkins-hbase9:45899] regionserver.HRegionServer(1504): Waiting on 1588230740, a31c75d31bc38f2da6b8ff6a09c13ed8 2023-07-14 09:15:41,687 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-14 09:15:41,687 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-14 09:15:41,703 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/hbase/meta/1588230740/.tmp/rep_barrier/40a5710b341d4286b4637271b22c2e6c 2023-07-14 09:15:41,708 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 09:15:41,708 INFO [RS:0;jenkins-hbase9:37313] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,37313,1689325949765; zookeeper connection closed. 2023-07-14 09:15:41,708 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:37313-0x101630d0c4a0001, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 09:15:41,709 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@611680fa] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@611680fa 2023-07-14 09:15:41,710 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 40a5710b341d4286b4637271b22c2e6c 2023-07-14 09:15:41,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/hbase/acl/2f3365ac32cf3617812342edf7d92305/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-14 09:15:41,712 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 09:15:41,713 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689325954708.2f3365ac32cf3617812342edf7d92305. 2023-07-14 09:15:41,713 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 2f3365ac32cf3617812342edf7d92305: 2023-07-14 09:15:41,713 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689325954708.2f3365ac32cf3617812342edf7d92305. 2023-07-14 09:15:41,871 INFO [RS:2;jenkins-hbase9:41875] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,41875,1689325950034; all regions closed. 2023-07-14 09:15:41,878 DEBUG [RS:1;jenkins-hbase9:45899] regionserver.HRegionServer(1504): Waiting on 1588230740, a31c75d31bc38f2da6b8ff6a09c13ed8 2023-07-14 09:15:41,881 DEBUG [RS:2;jenkins-hbase9:41875] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/oldWALs 2023-07-14 09:15:41,881 INFO [RS:2;jenkins-hbase9:41875] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C41875%2C1689325950034:(num 1689325952901) 2023-07-14 09:15:41,881 DEBUG [RS:2;jenkins-hbase9:41875] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:15:41,881 INFO [RS:2;jenkins-hbase9:41875] regionserver.LeaseManager(133): Closed leases 2023-07-14 09:15:41,881 INFO [RS:2;jenkins-hbase9:41875] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-14 09:15:41,887 INFO [RS:2;jenkins-hbase9:41875] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-14 09:15:41,887 INFO [RS:2;jenkins-hbase9:41875] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-14 09:15:41,887 INFO [RS:2;jenkins-hbase9:41875] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-14 09:15:41,887 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-14 09:15:41,888 INFO [RS:2;jenkins-hbase9:41875] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:41875 2023-07-14 09:15:41,890 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 09:15:41,890 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:15:41,891 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,41875,1689325950034 2023-07-14 09:15:41,891 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,41875,1689325950034] 2023-07-14 09:15:41,891 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,41875,1689325950034; numProcessing=2 2023-07-14 09:15:41,893 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,41875,1689325950034 already deleted, retry=false 2023-07-14 09:15:41,893 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,41875,1689325950034 expired; onlineServers=1 2023-07-14 09:15:41,965 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/hbase/namespace/a31c75d31bc38f2da6b8ff6a09c13ed8/.tmp/info/f61366a54b53467f871b110664e54cf8 2023-07-14 09:15:41,974 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/hbase/namespace/a31c75d31bc38f2da6b8ff6a09c13ed8/.tmp/info/f61366a54b53467f871b110664e54cf8 as hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/hbase/namespace/a31c75d31bc38f2da6b8ff6a09c13ed8/info/f61366a54b53467f871b110664e54cf8 2023-07-14 09:15:41,980 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/hbase/namespace/a31c75d31bc38f2da6b8ff6a09c13ed8/info/f61366a54b53467f871b110664e54cf8, entries=2, sequenceid=6, filesize=4.8 K 2023-07-14 09:15:41,981 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for a31c75d31bc38f2da6b8ff6a09c13ed8 in 530ms, sequenceid=6, compaction requested=false 2023-07-14 09:15:41,992 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 09:15:41,992 INFO [RS:2;jenkins-hbase9:41875] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,41875,1689325950034; zookeeper connection closed. 2023-07-14 09:15:41,992 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:41875-0x101630d0c4a0003, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 09:15:41,993 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/hbase/namespace/a31c75d31bc38f2da6b8ff6a09c13ed8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 09:15:41,994 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@665bf43a] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@665bf43a 2023-07-14 09:15:41,994 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 09:15:41,995 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689325953785.a31c75d31bc38f2da6b8ff6a09c13ed8. 2023-07-14 09:15:41,995 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for a31c75d31bc38f2da6b8ff6a09c13ed8: 2023-07-14 09:15:41,995 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689325953785.a31c75d31bc38f2da6b8ff6a09c13ed8. 2023-07-14 09:15:42,078 DEBUG [RS:1;jenkins-hbase9:45899] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-14 09:15:42,128 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/hbase/meta/1588230740/.tmp/table/719aa142f33244e3855e59973e6509ed 2023-07-14 09:15:42,135 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 719aa142f33244e3855e59973e6509ed 2023-07-14 09:15:42,136 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/hbase/meta/1588230740/.tmp/info/bdae23f3f80d407db426508bf5082615 as hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/hbase/meta/1588230740/info/bdae23f3f80d407db426508bf5082615 2023-07-14 09:15:42,141 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bdae23f3f80d407db426508bf5082615 2023-07-14 09:15:42,142 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/hbase/meta/1588230740/info/bdae23f3f80d407db426508bf5082615, entries=48, sequenceid=131, filesize=10.3 K 2023-07-14 09:15:42,143 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/hbase/meta/1588230740/.tmp/rep_barrier/40a5710b341d4286b4637271b22c2e6c as hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/hbase/meta/1588230740/rep_barrier/40a5710b341d4286b4637271b22c2e6c 2023-07-14 09:15:42,150 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 40a5710b341d4286b4637271b22c2e6c 2023-07-14 09:15:42,151 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/hbase/meta/1588230740/rep_barrier/40a5710b341d4286b4637271b22c2e6c, entries=13, sequenceid=131, filesize=6.4 K 2023-07-14 09:15:42,152 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/hbase/meta/1588230740/.tmp/table/719aa142f33244e3855e59973e6509ed as hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/hbase/meta/1588230740/table/719aa142f33244e3855e59973e6509ed 2023-07-14 09:15:42,160 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 719aa142f33244e3855e59973e6509ed 2023-07-14 09:15:42,160 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/hbase/meta/1588230740/table/719aa142f33244e3855e59973e6509ed, entries=24, sequenceid=131, filesize=6.9 K 2023-07-14 09:15:42,162 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 669ms, sequenceid=131, compaction requested=false 2023-07-14 09:15:42,202 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-14 09:15:42,203 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 09:15:42,203 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-14 09:15:42,204 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-14 09:15:42,204 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-14 09:15:42,204 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-14 09:15:42,279 INFO [RS:1;jenkins-hbase9:45899] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,45899,1689325949913; all regions closed. 2023-07-14 09:15:42,299 DEBUG [RS:1;jenkins-hbase9:45899] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/oldWALs 2023-07-14 09:15:42,299 INFO [RS:1;jenkins-hbase9:45899] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C45899%2C1689325949913.meta:.meta(num 1689325953281) 2023-07-14 09:15:42,340 DEBUG [RS:1;jenkins-hbase9:45899] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/oldWALs 2023-07-14 09:15:42,340 INFO [RS:1;jenkins-hbase9:45899] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C45899%2C1689325949913:(num 1689325952920) 2023-07-14 09:15:42,340 DEBUG [RS:1;jenkins-hbase9:45899] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:15:42,340 INFO [RS:1;jenkins-hbase9:45899] regionserver.LeaseManager(133): Closed leases 2023-07-14 09:15:42,340 INFO [RS:1;jenkins-hbase9:45899] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-14 09:15:42,341 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-14 09:15:42,342 INFO [RS:1;jenkins-hbase9:45899] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:45899 2023-07-14 09:15:42,345 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 09:15:42,345 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,45899,1689325949913 2023-07-14 09:15:42,345 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,45899,1689325949913] 2023-07-14 09:15:42,345 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,45899,1689325949913; numProcessing=3 2023-07-14 09:15:42,348 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,45899,1689325949913 already deleted, retry=false 2023-07-14 09:15:42,348 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,45899,1689325949913 expired; onlineServers=0 2023-07-14 09:15:42,348 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,41733,1689325948012' ***** 2023-07-14 09:15:42,348 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-14 09:15:42,349 DEBUG [M:0;jenkins-hbase9:41733] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d08137e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-14 09:15:42,349 INFO [M:0;jenkins-hbase9:41733] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,41733,1689325948012 2023-07-14 09:15:42,349 INFO [M:0;jenkins-hbase9:41733] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,41733,1689325948012; all regions closed. 2023-07-14 09:15:42,349 DEBUG [M:0;jenkins-hbase9:41733] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:15:42,349 DEBUG [M:0;jenkins-hbase9:41733] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-14 09:15:42,349 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-14 09:15:42,349 DEBUG [M:0;jenkins-hbase9:41733] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-14 09:15:42,349 INFO [M:0;jenkins-hbase9:41733] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-14 09:15:42,349 INFO [M:0;jenkins-hbase9:41733] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-14 09:15:42,349 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1689325952210] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1689325952210,5,FailOnTimeoutGroup] 2023-07-14 09:15:42,349 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1689325952216] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1689325952216,5,FailOnTimeoutGroup] 2023-07-14 09:15:42,350 INFO [M:0;jenkins-hbase9:41733] hbase.ChoreService(369): Chore service for: master/jenkins-hbase9:0 had [] on shutdown 2023-07-14 09:15:42,350 DEBUG [M:0;jenkins-hbase9:41733] master.HMaster(1512): Stopping service threads 2023-07-14 09:15:42,350 INFO [M:0;jenkins-hbase9:41733] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-14 09:15:42,350 ERROR [M:0;jenkins-hbase9:41733] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-23,5,PEWorkerGroup] Thread[HFileArchiver-24,5,PEWorkerGroup] 2023-07-14 09:15:42,351 INFO [M:0;jenkins-hbase9:41733] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-14 09:15:42,351 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-14 09:15:42,351 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-14 09:15:42,355 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 09:15:42,355 DEBUG [M:0;jenkins-hbase9:41733] zookeeper.ZKUtil(398): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-14 09:15:42,355 WARN [M:0;jenkins-hbase9:41733] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-14 09:15:42,355 INFO [M:0;jenkins-hbase9:41733] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-14 09:15:42,355 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-14 09:15:42,356 INFO [M:0;jenkins-hbase9:41733] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-14 09:15:42,356 DEBUG [M:0;jenkins-hbase9:41733] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-14 09:15:42,357 INFO [M:0;jenkins-hbase9:41733] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 09:15:42,357 DEBUG [M:0;jenkins-hbase9:41733] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 09:15:42,357 DEBUG [M:0;jenkins-hbase9:41733] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-14 09:15:42,357 DEBUG [M:0;jenkins-hbase9:41733] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 09:15:42,357 INFO [M:0;jenkins-hbase9:41733] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.69 KB heapSize=451.97 KB 2023-07-14 09:15:42,393 INFO [M:0;jenkins-hbase9:41733] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.69 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8f45f9136ce0499aa0a76339d18a2be8 2023-07-14 09:15:42,397 INFO [M:0;jenkins-hbase9:41733] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8f45f9136ce0499aa0a76339d18a2be8 2023-07-14 09:15:42,398 DEBUG [M:0;jenkins-hbase9:41733] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8f45f9136ce0499aa0a76339d18a2be8 as hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8f45f9136ce0499aa0a76339d18a2be8 2023-07-14 09:15:42,408 INFO [M:0;jenkins-hbase9:41733] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8f45f9136ce0499aa0a76339d18a2be8 2023-07-14 09:15:42,408 INFO [M:0;jenkins-hbase9:41733] regionserver.HStore(1080): Added hdfs://localhost:43771/user/jenkins/test-data/a0acc0a9-7ee2-3e82-7e17-88be272e9bd8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8f45f9136ce0499aa0a76339d18a2be8, entries=119, sequenceid=899, filesize=28.6 K 2023-07-14 09:15:42,409 INFO [M:0;jenkins-hbase9:41733] regionserver.HRegion(2948): Finished flush of dataSize ~375.69 KB/384706, heapSize ~451.95 KB/462800, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 52ms, sequenceid=899, compaction requested=false 2023-07-14 09:15:42,412 INFO [M:0;jenkins-hbase9:41733] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 09:15:42,412 DEBUG [M:0;jenkins-hbase9:41733] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-14 09:15:42,418 INFO [M:0;jenkins-hbase9:41733] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-14 09:15:42,418 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-14 09:15:42,419 INFO [M:0;jenkins-hbase9:41733] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:41733 2023-07-14 09:15:42,423 DEBUG [M:0;jenkins-hbase9:41733] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase9.apache.org,41733,1689325948012 already deleted, retry=false 2023-07-14 09:15:42,447 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 09:15:42,447 INFO [RS:1;jenkins-hbase9:45899] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,45899,1689325949913; zookeeper connection closed. 2023-07-14 09:15:42,447 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): regionserver:45899-0x101630d0c4a0002, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 09:15:42,447 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@364af374] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@364af374 2023-07-14 09:15:42,448 INFO [Listener at jenkins-hbase9.apache.org/45395] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-14 09:15:42,525 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 09:15:42,525 DEBUG [Listener at localhost/40607-EventThread] zookeeper.ZKWatcher(600): master:41733-0x101630d0c4a0000, quorum=127.0.0.1:59920, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 09:15:42,525 INFO [M:0;jenkins-hbase9:41733] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,41733,1689325948012; zookeeper connection closed. 2023-07-14 09:15:42,527 WARN [Listener at jenkins-hbase9.apache.org/45395] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-14 09:15:42,579 INFO [Listener at jenkins-hbase9.apache.org/45395] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-14 09:15:42,682 WARN [BP-290476497-172.31.2.10-1689325943675 heartbeating to localhost/127.0.0.1:43771] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-14 09:15:42,683 WARN [BP-290476497-172.31.2.10-1689325943675 heartbeating to localhost/127.0.0.1:43771] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-290476497-172.31.2.10-1689325943675 (Datanode Uuid bda4a42e-6e57-4416-82cd-c8e3023a91a2) service to localhost/127.0.0.1:43771 2023-07-14 09:15:42,686 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/cluster_57fe12f0-0229-b77c-f9b6-f833c5ee750b/dfs/data/data5/current/BP-290476497-172.31.2.10-1689325943675] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 09:15:42,687 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/cluster_57fe12f0-0229-b77c-f9b6-f833c5ee750b/dfs/data/data6/current/BP-290476497-172.31.2.10-1689325943675] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 09:15:42,688 WARN [Listener at jenkins-hbase9.apache.org/45395] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-14 09:15:42,728 INFO [Listener at jenkins-hbase9.apache.org/45395] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-14 09:15:42,731 WARN [BP-290476497-172.31.2.10-1689325943675 heartbeating to localhost/127.0.0.1:43771] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-14 09:15:42,732 WARN [BP-290476497-172.31.2.10-1689325943675 heartbeating to localhost/127.0.0.1:43771] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-290476497-172.31.2.10-1689325943675 (Datanode Uuid d7547804-6fb7-466e-b8b5-2fafb586c1f0) service to localhost/127.0.0.1:43771 2023-07-14 09:15:42,732 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/cluster_57fe12f0-0229-b77c-f9b6-f833c5ee750b/dfs/data/data3/current/BP-290476497-172.31.2.10-1689325943675] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 09:15:42,733 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/cluster_57fe12f0-0229-b77c-f9b6-f833c5ee750b/dfs/data/data4/current/BP-290476497-172.31.2.10-1689325943675] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 09:15:42,738 WARN [Listener at jenkins-hbase9.apache.org/45395] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-14 09:15:42,766 INFO [Listener at jenkins-hbase9.apache.org/45395] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-14 09:15:42,869 WARN [BP-290476497-172.31.2.10-1689325943675 heartbeating to localhost/127.0.0.1:43771] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-14 09:15:42,869 WARN [BP-290476497-172.31.2.10-1689325943675 heartbeating to localhost/127.0.0.1:43771] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-290476497-172.31.2.10-1689325943675 (Datanode Uuid 84c52bd0-90e3-4ce7-9095-0e067400d07d) service to localhost/127.0.0.1:43771 2023-07-14 09:15:42,870 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/cluster_57fe12f0-0229-b77c-f9b6-f833c5ee750b/dfs/data/data1/current/BP-290476497-172.31.2.10-1689325943675] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 09:15:42,870 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2ef595ba-16d0-a331-4ecc-6c8b232514a9/cluster_57fe12f0-0229-b77c-f9b6-f833c5ee750b/dfs/data/data2/current/BP-290476497-172.31.2.10-1689325943675] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 09:15:42,898 INFO [Listener at jenkins-hbase9.apache.org/45395] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-14 09:15:42,938 INFO [Listener at jenkins-hbase9.apache.org/45395] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-14 09:15:43,057 INFO [Listener at jenkins-hbase9.apache.org/45395] hbase.HBaseTestingUtility(1293): Minicluster is down