2023-09-28 20:00:55,542 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-09-28 20:00:55,772 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7 2023-09-28 20:00:55,772 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-09-28 20:00:55,772 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-09-28 20:00:55,810 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-09-28 20:00:56,083 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-09-28 20:00:56,084 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/cluster_5fb315ef-67a6-d9cd-3b9f-c66cc0d16763, deleteOnExit=true 2023-09-28 20:00:56,084 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-09-28 20:00:56,085 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/test.cache.data in system properties and HBase conf 2023-09-28 20:00:56,085 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/hadoop.tmp.dir in system properties and HBase conf 2023-09-28 20:00:56,086 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/hadoop.log.dir in system properties and HBase conf 2023-09-28 20:00:56,086 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-28 20:00:56,087 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-28 20:00:56,087 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-28 20:00:56,443 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-09-28 20:00:56,448 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-28 20:00:56,449 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-28 20:00:56,449 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-28 20:00:56,449 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-28 20:00:56,449 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-28 20:00:56,450 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-28 20:00:56,450 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-28 20:00:56,450 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-28 20:00:56,451 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-28 20:00:56,451 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/nfs.dump.dir in system properties and HBase conf 2023-09-28 20:00:56,452 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/java.io.tmpdir in system properties and HBase conf 2023-09-28 20:00:56,452 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-28 20:00:56,453 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-28 20:00:56,453 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-09-28 20:00:56,971 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-28 20:00:56,976 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-28 20:00:57,300 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-09-28 20:00:57,509 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-09-28 20:00:57,526 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-28 20:00:57,571 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-09-28 20:00:57,608 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/java.io.tmpdir/Jetty_localhost_36909_hdfs____mxta3t/webapp 2023-09-28 20:00:57,761 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36909 2023-09-28 20:00:57,773 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-28 20:00:57,773 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-28 20:00:58,297 WARN [Listener at localhost/43143] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-28 20:00:58,384 WARN [Listener at localhost/43143] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-28 20:00:58,414 WARN [Listener at localhost/43143] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-28 20:00:58,466 INFO [Listener at localhost/43143] log.Slf4jLog(67): jetty-6.1.26 2023-09-28 20:00:58,476 INFO [Listener at localhost/43143] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/java.io.tmpdir/Jetty_localhost_33641_datanode____5ozh2y/webapp 2023-09-28 20:00:58,576 INFO [Listener at localhost/43143] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33641 2023-09-28 20:00:58,985 WARN [Listener at localhost/38011] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-28 20:00:59,014 WARN [Listener at localhost/38011] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-28 20:00:59,018 WARN [Listener at localhost/38011] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-28 20:00:59,020 INFO [Listener at localhost/38011] log.Slf4jLog(67): jetty-6.1.26 2023-09-28 20:00:59,030 INFO [Listener at localhost/38011] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/java.io.tmpdir/Jetty_localhost_43907_datanode____.yuyoag/webapp 2023-09-28 20:00:59,162 INFO [Listener at localhost/38011] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43907 2023-09-28 20:00:59,174 WARN [Listener at localhost/39027] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-28 20:00:59,203 WARN [Listener at localhost/39027] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-28 20:00:59,207 WARN [Listener at localhost/39027] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-28 20:00:59,210 INFO [Listener at localhost/39027] log.Slf4jLog(67): jetty-6.1.26 2023-09-28 20:00:59,223 INFO [Listener at localhost/39027] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/java.io.tmpdir/Jetty_localhost_37669_datanode____.cl7gg4/webapp 2023-09-28 20:00:59,356 INFO [Listener at localhost/39027] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37669 2023-09-28 20:00:59,369 WARN [Listener at localhost/38989] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-28 20:00:59,597 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb7db4fc33b467dac: Processing first storage report for DS-302719a4-3515-4307-aa76-b269f1b93555 from datanode 3437b551-e86c-45cd-bc77-d2833165be93 2023-09-28 20:00:59,599 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb7db4fc33b467dac: from storage DS-302719a4-3515-4307-aa76-b269f1b93555 node DatanodeRegistration(127.0.0.1:42807, datanodeUuid=3437b551-e86c-45cd-bc77-d2833165be93, infoPort=45197, infoSecurePort=0, ipcPort=39027, storageInfo=lv=-57;cid=testClusterID;nsid=948965905;c=1695931257066), blocks: 0, hasStaleStorage: true, processing time: 3 msecs, invalidatedBlocks: 0 2023-09-28 20:00:59,599 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5a8c89187e456a95: Processing first storage report for DS-dc7d4874-542d-42b2-ad45-c0c92a30e9da from datanode fa9e69d3-666e-49d5-b2b3-2fea61b7694c 2023-09-28 20:00:59,600 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5a8c89187e456a95: from storage DS-dc7d4874-542d-42b2-ad45-c0c92a30e9da node DatanodeRegistration(127.0.0.1:44003, datanodeUuid=fa9e69d3-666e-49d5-b2b3-2fea61b7694c, infoPort=44083, infoSecurePort=0, ipcPort=38011, storageInfo=lv=-57;cid=testClusterID;nsid=948965905;c=1695931257066), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-28 20:00:59,600 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x12b9a3a5986b6e46: Processing first storage report for DS-ad36875b-cc72-4e0b-a3d5-1104ee8961f4 from datanode fb49aab3-6eb6-447b-acbd-f5bf34dbadf1 2023-09-28 20:00:59,600 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x12b9a3a5986b6e46: from storage DS-ad36875b-cc72-4e0b-a3d5-1104ee8961f4 node DatanodeRegistration(127.0.0.1:44957, datanodeUuid=fb49aab3-6eb6-447b-acbd-f5bf34dbadf1, infoPort=38673, infoSecurePort=0, ipcPort=38989, storageInfo=lv=-57;cid=testClusterID;nsid=948965905;c=1695931257066), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-28 20:00:59,600 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb7db4fc33b467dac: Processing first storage report for DS-5f25e8fd-7c1b-42f3-8f5b-b56f5c087dba from datanode 3437b551-e86c-45cd-bc77-d2833165be93 2023-09-28 20:00:59,600 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb7db4fc33b467dac: from storage DS-5f25e8fd-7c1b-42f3-8f5b-b56f5c087dba node DatanodeRegistration(127.0.0.1:42807, datanodeUuid=3437b551-e86c-45cd-bc77-d2833165be93, infoPort=45197, infoSecurePort=0, ipcPort=39027, storageInfo=lv=-57;cid=testClusterID;nsid=948965905;c=1695931257066), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-09-28 20:00:59,600 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5a8c89187e456a95: Processing first storage report for DS-d279a745-00ee-4c7b-8115-cfce4195f446 from datanode fa9e69d3-666e-49d5-b2b3-2fea61b7694c 2023-09-28 20:00:59,600 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5a8c89187e456a95: from storage DS-d279a745-00ee-4c7b-8115-cfce4195f446 node DatanodeRegistration(127.0.0.1:44003, datanodeUuid=fa9e69d3-666e-49d5-b2b3-2fea61b7694c, infoPort=44083, infoSecurePort=0, ipcPort=38011, storageInfo=lv=-57;cid=testClusterID;nsid=948965905;c=1695931257066), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-28 20:00:59,601 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x12b9a3a5986b6e46: Processing first storage report for DS-a7819149-9d29-4ecd-92da-4b935395b2d8 from datanode fb49aab3-6eb6-447b-acbd-f5bf34dbadf1 2023-09-28 20:00:59,601 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x12b9a3a5986b6e46: from storage DS-a7819149-9d29-4ecd-92da-4b935395b2d8 node DatanodeRegistration(127.0.0.1:44957, datanodeUuid=fb49aab3-6eb6-447b-acbd-f5bf34dbadf1, infoPort=38673, infoSecurePort=0, ipcPort=38989, storageInfo=lv=-57;cid=testClusterID;nsid=948965905;c=1695931257066), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-28 20:00:59,856 DEBUG [Listener at localhost/38989] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7 2023-09-28 20:00:59,949 INFO [Listener at localhost/38989] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/cluster_5fb315ef-67a6-d9cd-3b9f-c66cc0d16763/zookeeper_0, clientPort=50329, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/cluster_5fb315ef-67a6-d9cd-3b9f-c66cc0d16763/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/cluster_5fb315ef-67a6-d9cd-3b9f-c66cc0d16763/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-09-28 20:00:59,969 INFO [Listener at localhost/38989] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=50329 2023-09-28 20:00:59,978 INFO [Listener at localhost/38989] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-28 20:00:59,980 INFO [Listener at localhost/38989] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-28 20:01:00,693 INFO [Listener at localhost/38989] util.FSUtils(471): Created version file at hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff with version=8 2023-09-28 20:01:00,694 INFO [Listener at localhost/38989] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/hbase-staging 2023-09-28 20:01:01,051 INFO [Listener at localhost/38989] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-09-28 20:01:01,571 INFO [Listener at localhost/38989] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-09-28 20:01:01,605 INFO [Listener at localhost/38989] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-28 20:01:01,606 INFO [Listener at localhost/38989] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-28 20:01:01,606 INFO [Listener at localhost/38989] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-28 20:01:01,606 INFO [Listener at localhost/38989] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-28 20:01:01,606 INFO [Listener at localhost/38989] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-28 20:01:01,765 INFO [Listener at localhost/38989] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-09-28 20:01:01,843 DEBUG [Listener at localhost/38989] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-09-28 20:01:01,942 INFO [Listener at localhost/38989] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35173 2023-09-28 20:01:01,956 INFO [Listener at localhost/38989] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-28 20:01:01,958 INFO [Listener at localhost/38989] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-28 20:01:01,985 INFO [Listener at localhost/38989] zookeeper.RecoverableZooKeeper(93): Process identifier=master:35173 connecting to ZooKeeper ensemble=127.0.0.1:50329 2023-09-28 20:01:02,048 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:351730x0, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-28 20:01:02,052 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:35173-0x100f42093bb0000 connected 2023-09-28 20:01:02,093 DEBUG [Listener at localhost/38989] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-28 20:01:02,094 DEBUG [Listener at localhost/38989] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-28 20:01:02,108 DEBUG [Listener at localhost/38989] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-28 20:01:02,118 DEBUG [Listener at localhost/38989] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35173 2023-09-28 20:01:02,119 DEBUG [Listener at localhost/38989] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35173 2023-09-28 20:01:02,119 DEBUG [Listener at localhost/38989] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35173 2023-09-28 20:01:02,120 DEBUG [Listener at localhost/38989] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35173 2023-09-28 20:01:02,120 DEBUG [Listener at localhost/38989] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35173 2023-09-28 20:01:02,127 INFO [Listener at localhost/38989] master.HMaster(444): hbase.rootdir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff, hbase.cluster.distributed=false 2023-09-28 20:01:02,193 INFO [Listener at localhost/38989] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-28 20:01:02,193 INFO [Listener at localhost/38989] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-28 20:01:02,194 INFO [Listener at localhost/38989] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-28 20:01:02,194 INFO [Listener at localhost/38989] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-28 20:01:02,194 INFO [Listener at localhost/38989] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-28 20:01:02,194 INFO [Listener at localhost/38989] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-28 20:01:02,199 INFO [Listener at localhost/38989] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-28 20:01:02,202 INFO [Listener at localhost/38989] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46795 2023-09-28 20:01:02,205 INFO [Listener at localhost/38989] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-28 20:01:02,212 INFO [Listener at localhost/38989] mob.MobFileCache(125): MobFileCache disabled 2023-09-28 20:01:02,213 INFO [Listener at localhost/38989] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-28 20:01:02,215 INFO [Listener at localhost/38989] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-28 20:01:02,218 INFO [Listener at localhost/38989] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46795 connecting to ZooKeeper ensemble=127.0.0.1:50329 2023-09-28 20:01:02,221 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:467950x0, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-28 20:01:02,223 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:46795-0x100f42093bb0001 connected 2023-09-28 20:01:02,223 DEBUG [Listener at localhost/38989] zookeeper.ZKUtil(164): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-28 20:01:02,224 DEBUG [Listener at localhost/38989] zookeeper.ZKUtil(164): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-28 20:01:02,225 DEBUG [Listener at localhost/38989] zookeeper.ZKUtil(164): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-28 20:01:02,226 DEBUG [Listener at localhost/38989] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46795 2023-09-28 20:01:02,226 DEBUG [Listener at localhost/38989] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46795 2023-09-28 20:01:02,227 DEBUG [Listener at localhost/38989] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46795 2023-09-28 20:01:02,227 DEBUG [Listener at localhost/38989] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46795 2023-09-28 20:01:02,227 DEBUG [Listener at localhost/38989] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46795 2023-09-28 20:01:02,241 INFO [Listener at localhost/38989] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-28 20:01:02,241 INFO [Listener at localhost/38989] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-28 20:01:02,241 INFO [Listener at localhost/38989] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-28 20:01:02,242 INFO [Listener at localhost/38989] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-28 20:01:02,242 INFO [Listener at localhost/38989] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-28 20:01:02,242 INFO [Listener at localhost/38989] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-28 20:01:02,242 INFO [Listener at localhost/38989] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-28 20:01:02,244 INFO [Listener at localhost/38989] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38759 2023-09-28 20:01:02,245 INFO [Listener at localhost/38989] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-28 20:01:02,247 INFO [Listener at localhost/38989] mob.MobFileCache(125): MobFileCache disabled 2023-09-28 20:01:02,248 INFO [Listener at localhost/38989] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-28 20:01:02,251 INFO [Listener at localhost/38989] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-28 20:01:02,253 INFO [Listener at localhost/38989] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38759 connecting to ZooKeeper ensemble=127.0.0.1:50329 2023-09-28 20:01:02,258 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:387590x0, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-28 20:01:02,260 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:38759-0x100f42093bb0002 connected 2023-09-28 20:01:02,260 DEBUG [Listener at localhost/38989] zookeeper.ZKUtil(164): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-28 20:01:02,261 DEBUG [Listener at localhost/38989] zookeeper.ZKUtil(164): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-28 20:01:02,262 DEBUG [Listener at localhost/38989] zookeeper.ZKUtil(164): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-28 20:01:02,265 DEBUG [Listener at localhost/38989] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38759 2023-09-28 20:01:02,265 DEBUG [Listener at localhost/38989] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38759 2023-09-28 20:01:02,265 DEBUG [Listener at localhost/38989] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38759 2023-09-28 20:01:02,269 DEBUG [Listener at localhost/38989] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38759 2023-09-28 20:01:02,269 DEBUG [Listener at localhost/38989] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38759 2023-09-28 20:01:02,282 INFO [Listener at localhost/38989] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-28 20:01:02,282 INFO [Listener at localhost/38989] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-28 20:01:02,283 INFO [Listener at localhost/38989] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-28 20:01:02,283 INFO [Listener at localhost/38989] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-28 20:01:02,283 INFO [Listener at localhost/38989] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-28 20:01:02,283 INFO [Listener at localhost/38989] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-28 20:01:02,283 INFO [Listener at localhost/38989] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-28 20:01:02,286 INFO [Listener at localhost/38989] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33091 2023-09-28 20:01:02,286 INFO [Listener at localhost/38989] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-28 20:01:02,287 INFO [Listener at localhost/38989] mob.MobFileCache(125): MobFileCache disabled 2023-09-28 20:01:02,289 INFO [Listener at localhost/38989] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-28 20:01:02,291 INFO [Listener at localhost/38989] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-28 20:01:02,293 INFO [Listener at localhost/38989] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33091 connecting to ZooKeeper ensemble=127.0.0.1:50329 2023-09-28 20:01:02,297 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:330910x0, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-28 20:01:02,298 DEBUG [Listener at localhost/38989] zookeeper.ZKUtil(164): regionserver:330910x0, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-28 20:01:02,298 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:33091-0x100f42093bb0003 connected 2023-09-28 20:01:02,299 DEBUG [Listener at localhost/38989] zookeeper.ZKUtil(164): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-28 20:01:02,300 DEBUG [Listener at localhost/38989] zookeeper.ZKUtil(164): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-28 20:01:02,302 DEBUG [Listener at localhost/38989] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33091 2023-09-28 20:01:02,305 DEBUG [Listener at localhost/38989] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33091 2023-09-28 20:01:02,305 DEBUG [Listener at localhost/38989] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33091 2023-09-28 20:01:02,306 DEBUG [Listener at localhost/38989] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33091 2023-09-28 20:01:02,306 DEBUG [Listener at localhost/38989] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33091 2023-09-28 20:01:02,308 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,35173,1695931260872 2023-09-28 20:01:02,322 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-28 20:01:02,323 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,35173,1695931260872 2023-09-28 20:01:02,344 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-28 20:01:02,345 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-28 20:01:02,344 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-28 20:01:02,344 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-28 20:01:02,345 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-28 20:01:02,347 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-28 20:01:02,348 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,35173,1695931260872 from backup master directory 2023-09-28 20:01:02,349 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-28 20:01:02,353 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,35173,1695931260872 2023-09-28 20:01:02,353 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-28 20:01:02,354 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-28 20:01:02,354 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,35173,1695931260872 2023-09-28 20:01:02,358 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-09-28 20:01:02,359 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-09-28 20:01:02,468 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/hbase.id with ID: d1c8ee54-d108-48b7-afac-57869cd3649f 2023-09-28 20:01:02,518 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-28 20:01:02,537 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-28 20:01:02,599 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x10077163 to 127.0.0.1:50329 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 20:01:02,636 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@77163a68, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 20:01:02,662 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-28 20:01:02,664 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-09-28 20:01:02,683 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-09-28 20:01:02,683 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-09-28 20:01:02,686 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-28 20:01:02,690 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-28 20:01:02,692 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-28 20:01:02,731 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/MasterData/data/master/store-tmp 2023-09-28 20:01:02,773 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 20:01:02,773 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-28 20:01:02,773 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-28 20:01:02,773 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-28 20:01:02,773 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-28 20:01:02,773 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-28 20:01:02,773 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-28 20:01:02,773 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-28 20:01:02,775 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/MasterData/WALs/jenkins-hbase4.apache.org,35173,1695931260872 2023-09-28 20:01:02,801 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35173%2C1695931260872, suffix=, logDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/MasterData/WALs/jenkins-hbase4.apache.org,35173,1695931260872, archiveDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/MasterData/oldWALs, maxLogs=10 2023-09-28 20:01:02,861 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44003,DS-dc7d4874-542d-42b2-ad45-c0c92a30e9da,DISK] 2023-09-28 20:01:02,861 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42807,DS-302719a4-3515-4307-aa76-b269f1b93555,DISK] 2023-09-28 20:01:02,861 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44957,DS-ad36875b-cc72-4e0b-a3d5-1104ee8961f4,DISK] 2023-09-28 20:01:02,872 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-09-28 20:01:02,943 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/MasterData/WALs/jenkins-hbase4.apache.org,35173,1695931260872/jenkins-hbase4.apache.org%2C35173%2C1695931260872.1695931262813 2023-09-28 20:01:02,944 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44957,DS-ad36875b-cc72-4e0b-a3d5-1104ee8961f4,DISK], DatanodeInfoWithStorage[127.0.0.1:42807,DS-302719a4-3515-4307-aa76-b269f1b93555,DISK], DatanodeInfoWithStorage[127.0.0.1:44003,DS-dc7d4874-542d-42b2-ad45-c0c92a30e9da,DISK]] 2023-09-28 20:01:02,944 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-09-28 20:01:02,945 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 20:01:02,948 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-09-28 20:01:02,949 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-09-28 20:01:03,022 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-09-28 20:01:03,030 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-09-28 20:01:03,066 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-09-28 20:01:03,081 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 20:01:03,089 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-28 20:01:03,091 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-28 20:01:03,106 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-09-28 20:01:03,110 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 20:01:03,111 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64036705, jitterRate=-0.04577873647212982}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 20:01:03,112 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-28 20:01:03,113 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-09-28 20:01:03,137 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-09-28 20:01:03,137 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-09-28 20:01:03,140 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-09-28 20:01:03,142 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-09-28 20:01:03,181 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 38 msec 2023-09-28 20:01:03,181 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-09-28 20:01:03,213 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-09-28 20:01:03,218 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-09-28 20:01:03,246 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-09-28 20:01:03,251 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-09-28 20:01:03,252 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-09-28 20:01:03,259 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-09-28 20:01:03,263 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-09-28 20:01:03,266 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-28 20:01:03,268 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-09-28 20:01:03,268 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-09-28 20:01:03,283 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-09-28 20:01:03,288 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-28 20:01:03,288 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-28 20:01:03,288 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-28 20:01:03,288 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-28 20:01:03,288 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-28 20:01:03,289 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,35173,1695931260872, sessionid=0x100f42093bb0000, setting cluster-up flag (Was=false) 2023-09-28 20:01:03,312 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-28 20:01:03,318 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-09-28 20:01:03,319 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35173,1695931260872 2023-09-28 20:01:03,326 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-28 20:01:03,332 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-09-28 20:01:03,333 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35173,1695931260872 2023-09-28 20:01:03,336 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/.tmp 2023-09-28 20:01:03,411 INFO [RS:1;jenkins-hbase4:38759] regionserver.HRegionServer(951): ClusterId : d1c8ee54-d108-48b7-afac-57869cd3649f 2023-09-28 20:01:03,411 INFO [RS:2;jenkins-hbase4:33091] regionserver.HRegionServer(951): ClusterId : d1c8ee54-d108-48b7-afac-57869cd3649f 2023-09-28 20:01:03,412 INFO [RS:0;jenkins-hbase4:46795] regionserver.HRegionServer(951): ClusterId : d1c8ee54-d108-48b7-afac-57869cd3649f 2023-09-28 20:01:03,416 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-09-28 20:01:03,418 DEBUG [RS:0;jenkins-hbase4:46795] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-28 20:01:03,418 DEBUG [RS:1;jenkins-hbase4:38759] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-28 20:01:03,418 DEBUG [RS:2;jenkins-hbase4:33091] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-28 20:01:03,422 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 20:01:03,422 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-09-28 20:01:03,426 DEBUG [RS:1;jenkins-hbase4:38759] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-28 20:01:03,426 DEBUG [RS:0;jenkins-hbase4:46795] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-28 20:01:03,426 DEBUG [RS:2;jenkins-hbase4:33091] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-28 20:01:03,426 DEBUG [RS:0;jenkins-hbase4:46795] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-28 20:01:03,426 DEBUG [RS:1;jenkins-hbase4:38759] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-28 20:01:03,426 DEBUG [RS:2;jenkins-hbase4:33091] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-28 20:01:03,433 DEBUG [RS:2;jenkins-hbase4:33091] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-28 20:01:03,433 DEBUG [RS:1;jenkins-hbase4:38759] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-28 20:01:03,433 DEBUG [RS:0;jenkins-hbase4:46795] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-28 20:01:03,438 DEBUG [RS:1;jenkins-hbase4:38759] zookeeper.ReadOnlyZKClient(139): Connect 0x44f33540 to 127.0.0.1:50329 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 20:01:03,438 DEBUG [RS:0;jenkins-hbase4:46795] zookeeper.ReadOnlyZKClient(139): Connect 0x11571638 to 127.0.0.1:50329 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 20:01:03,438 DEBUG [RS:2;jenkins-hbase4:33091] zookeeper.ReadOnlyZKClient(139): Connect 0x774d9bf2 to 127.0.0.1:50329 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 20:01:03,447 DEBUG [RS:1;jenkins-hbase4:38759] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4a34d3ae, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 20:01:03,448 DEBUG [RS:1;jenkins-hbase4:38759] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e0b5e30, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-28 20:01:03,480 DEBUG [RS:0;jenkins-hbase4:46795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1f90fa62, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 20:01:03,480 DEBUG [RS:0;jenkins-hbase4:46795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1baf7d48, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-28 20:01:03,481 DEBUG [RS:2;jenkins-hbase4:33091] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@798a6b6b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 20:01:03,482 DEBUG [RS:2;jenkins-hbase4:33091] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@38b76150, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-28 20:01:03,501 DEBUG [RS:1;jenkins-hbase4:38759] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:38759 2023-09-28 20:01:03,503 DEBUG [RS:0;jenkins-hbase4:46795] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:46795 2023-09-28 20:01:03,505 DEBUG [RS:2;jenkins-hbase4:33091] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:33091 2023-09-28 20:01:03,506 INFO [RS:1;jenkins-hbase4:38759] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-28 20:01:03,506 INFO [RS:2;jenkins-hbase4:33091] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-28 20:01:03,506 INFO [RS:2;jenkins-hbase4:33091] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-28 20:01:03,506 INFO [RS:0;jenkins-hbase4:46795] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-28 20:01:03,506 INFO [RS:1;jenkins-hbase4:38759] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-28 20:01:03,507 INFO [RS:0;jenkins-hbase4:46795] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-28 20:01:03,507 DEBUG [RS:1;jenkins-hbase4:38759] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-28 20:01:03,507 DEBUG [RS:0;jenkins-hbase4:46795] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-28 20:01:03,507 DEBUG [RS:2;jenkins-hbase4:33091] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-28 20:01:03,508 INFO [RS:1;jenkins-hbase4:38759] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 20:01:03,509 INFO [RS:0;jenkins-hbase4:46795] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 20:01:03,509 INFO [RS:2;jenkins-hbase4:33091] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 20:01:03,509 DEBUG [RS:0;jenkins-hbase4:46795] regionserver.HRegionServer(1022): About to register with Master. 2023-09-28 20:01:03,509 DEBUG [RS:1;jenkins-hbase4:38759] regionserver.HRegionServer(1022): About to register with Master. 2023-09-28 20:01:03,509 DEBUG [RS:2;jenkins-hbase4:33091] regionserver.HRegionServer(1022): About to register with Master. 2023-09-28 20:01:03,512 INFO [RS:0;jenkins-hbase4:46795] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,35173,1695931260872 with isa=jenkins-hbase4.apache.org/172.31.14.131:46795, startcode=1695931262192 2023-09-28 20:01:03,512 INFO [RS:2;jenkins-hbase4:33091] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,35173,1695931260872 with isa=jenkins-hbase4.apache.org/172.31.14.131:33091, startcode=1695931262281 2023-09-28 20:01:03,512 INFO [RS:1;jenkins-hbase4:38759] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,35173,1695931260872 with isa=jenkins-hbase4.apache.org/172.31.14.131:38759, startcode=1695931262240 2023-09-28 20:01:03,529 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-09-28 20:01:03,532 DEBUG [RS:2;jenkins-hbase4:33091] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-28 20:01:03,532 DEBUG [RS:1;jenkins-hbase4:38759] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-28 20:01:03,532 DEBUG [RS:0;jenkins-hbase4:46795] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-28 20:01:03,541 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-28 20:01:03,541 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-28 20:01:03,541 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-28 20:01:03,541 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-28 20:01:03,541 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-09-28 20:01:03,541 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 20:01:03,542 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-28 20:01:03,542 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 20:01:03,543 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1695931293543 2023-09-28 20:01:03,547 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-09-28 20:01:03,552 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-09-28 20:01:03,553 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-09-28 20:01:03,562 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-28 20:01:03,564 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-09-28 20:01:03,573 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-09-28 20:01:03,574 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-09-28 20:01:03,574 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-09-28 20:01:03,574 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-09-28 20:01:03,575 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-28 20:01:03,577 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-09-28 20:01:03,579 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-09-28 20:01:03,579 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-09-28 20:01:03,582 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-09-28 20:01:03,582 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-09-28 20:01:03,585 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695931263584,5,FailOnTimeoutGroup] 2023-09-28 20:01:03,585 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695931263585,5,FailOnTimeoutGroup] 2023-09-28 20:01:03,585 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-28 20:01:03,585 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-09-28 20:01:03,588 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-09-28 20:01:03,588 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-09-28 20:01:03,609 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55151, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-09-28 20:01:03,609 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39245, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-09-28 20:01:03,609 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43333, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-09-28 20:01:03,623 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-28 20:01:03,624 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-28 20:01:03,625 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff 2023-09-28 20:01:03,627 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35173] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:03,643 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35173] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:03,647 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35173] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:03,656 DEBUG [RS:0;jenkins-hbase4:46795] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff 2023-09-28 20:01:03,656 DEBUG [RS:1;jenkins-hbase4:38759] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff 2023-09-28 20:01:03,656 DEBUG [RS:2;jenkins-hbase4:33091] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff 2023-09-28 20:01:03,657 DEBUG [RS:1;jenkins-hbase4:38759] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:43143 2023-09-28 20:01:03,657 DEBUG [RS:1;jenkins-hbase4:38759] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-28 20:01:03,660 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 20:01:03,657 DEBUG [RS:0;jenkins-hbase4:46795] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:43143 2023-09-28 20:01:03,657 DEBUG [RS:2;jenkins-hbase4:33091] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:43143 2023-09-28 20:01:03,661 DEBUG [RS:0;jenkins-hbase4:46795] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-28 20:01:03,661 DEBUG [RS:2;jenkins-hbase4:33091] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-28 20:01:03,663 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-28 20:01:03,667 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/hbase/meta/1588230740/info 2023-09-28 20:01:03,667 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-28 20:01:03,668 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 20:01:03,669 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-28 20:01:03,669 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-28 20:01:03,670 DEBUG [RS:1;jenkins-hbase4:38759] zookeeper.ZKUtil(162): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:03,670 DEBUG [RS:0;jenkins-hbase4:46795] zookeeper.ZKUtil(162): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:03,670 WARN [RS:1;jenkins-hbase4:38759] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-28 20:01:03,670 WARN [RS:0;jenkins-hbase4:46795] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-28 20:01:03,671 DEBUG [RS:2;jenkins-hbase4:33091] zookeeper.ZKUtil(162): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:03,671 INFO [RS:1;jenkins-hbase4:38759] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-28 20:01:03,672 DEBUG [RS:1;jenkins-hbase4:38759] regionserver.HRegionServer(1948): logDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/WALs/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:03,671 INFO [RS:0;jenkins-hbase4:46795] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-28 20:01:03,672 WARN [RS:2;jenkins-hbase4:33091] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-28 20:01:03,672 DEBUG [RS:0;jenkins-hbase4:46795] regionserver.HRegionServer(1948): logDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/WALs/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:03,672 INFO [RS:2;jenkins-hbase4:33091] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-28 20:01:03,673 DEBUG [RS:2;jenkins-hbase4:33091] regionserver.HRegionServer(1948): logDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/WALs/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:03,673 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38759,1695931262240] 2023-09-28 20:01:03,673 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46795,1695931262192] 2023-09-28 20:01:03,673 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33091,1695931262281] 2023-09-28 20:01:03,675 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/hbase/meta/1588230740/rep_barrier 2023-09-28 20:01:03,677 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-28 20:01:03,679 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 20:01:03,679 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-28 20:01:03,682 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/hbase/meta/1588230740/table 2023-09-28 20:01:03,683 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-28 20:01:03,684 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 20:01:03,687 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/hbase/meta/1588230740 2023-09-28 20:01:03,688 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/hbase/meta/1588230740 2023-09-28 20:01:03,689 DEBUG [RS:1;jenkins-hbase4:38759] zookeeper.ZKUtil(162): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:03,689 DEBUG [RS:2;jenkins-hbase4:33091] zookeeper.ZKUtil(162): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:03,690 DEBUG [RS:1;jenkins-hbase4:38759] zookeeper.ZKUtil(162): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:03,690 DEBUG [RS:0;jenkins-hbase4:46795] zookeeper.ZKUtil(162): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:03,690 DEBUG [RS:2;jenkins-hbase4:33091] zookeeper.ZKUtil(162): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:03,690 DEBUG [RS:0;jenkins-hbase4:46795] zookeeper.ZKUtil(162): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:03,690 DEBUG [RS:1;jenkins-hbase4:38759] zookeeper.ZKUtil(162): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:03,690 DEBUG [RS:2;jenkins-hbase4:33091] zookeeper.ZKUtil(162): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:03,691 DEBUG [RS:0;jenkins-hbase4:46795] zookeeper.ZKUtil(162): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:03,700 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-28 20:01:03,703 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-28 20:01:03,705 DEBUG [RS:0;jenkins-hbase4:46795] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-28 20:01:03,705 DEBUG [RS:1;jenkins-hbase4:38759] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-28 20:01:03,705 DEBUG [RS:2;jenkins-hbase4:33091] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-28 20:01:03,708 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 20:01:03,710 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68203640, jitterRate=0.01631343364715576}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-28 20:01:03,710 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-28 20:01:03,710 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-28 20:01:03,710 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-28 20:01:03,710 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-28 20:01:03,710 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-28 20:01:03,710 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-28 20:01:03,712 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-28 20:01:03,713 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-28 20:01:03,718 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-09-28 20:01:03,718 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-09-28 20:01:03,719 INFO [RS:2;jenkins-hbase4:33091] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-28 20:01:03,720 INFO [RS:1;jenkins-hbase4:38759] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-28 20:01:03,719 INFO [RS:0;jenkins-hbase4:46795] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-28 20:01:03,731 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-09-28 20:01:03,744 INFO [RS:0;jenkins-hbase4:46795] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-28 20:01:03,745 INFO [RS:1;jenkins-hbase4:38759] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-28 20:01:03,749 INFO [RS:2;jenkins-hbase4:33091] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-28 20:01:03,752 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-09-28 20:01:03,756 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-09-28 20:01:03,756 INFO [RS:0;jenkins-hbase4:46795] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-28 20:01:03,756 INFO [RS:0;jenkins-hbase4:46795] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-28 20:01:03,757 INFO [RS:2;jenkins-hbase4:33091] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-28 20:01:03,757 INFO [RS:1;jenkins-hbase4:38759] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-28 20:01:03,760 INFO [RS:0;jenkins-hbase4:46795] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-28 20:01:03,760 INFO [RS:2;jenkins-hbase4:33091] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-28 20:01:03,760 INFO [RS:1;jenkins-hbase4:38759] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-28 20:01:03,760 INFO [RS:2;jenkins-hbase4:33091] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-28 20:01:03,761 INFO [RS:1;jenkins-hbase4:38759] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-28 20:01:03,770 INFO [RS:2;jenkins-hbase4:33091] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-28 20:01:03,770 INFO [RS:1;jenkins-hbase4:38759] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-28 20:01:03,770 INFO [RS:0;jenkins-hbase4:46795] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-28 20:01:03,770 DEBUG [RS:2;jenkins-hbase4:33091] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 20:01:03,770 DEBUG [RS:0;jenkins-hbase4:46795] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 20:01:03,771 DEBUG [RS:2;jenkins-hbase4:33091] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 20:01:03,771 DEBUG [RS:0;jenkins-hbase4:46795] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 20:01:03,771 DEBUG [RS:2;jenkins-hbase4:33091] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 20:01:03,771 DEBUG [RS:0;jenkins-hbase4:46795] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 20:01:03,771 DEBUG [RS:2;jenkins-hbase4:33091] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 20:01:03,771 DEBUG [RS:0;jenkins-hbase4:46795] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 20:01:03,771 DEBUG [RS:2;jenkins-hbase4:33091] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 20:01:03,771 DEBUG [RS:0;jenkins-hbase4:46795] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 20:01:03,772 DEBUG [RS:2;jenkins-hbase4:33091] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-28 20:01:03,772 DEBUG [RS:0;jenkins-hbase4:46795] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-28 20:01:03,772 DEBUG [RS:2;jenkins-hbase4:33091] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 20:01:03,772 DEBUG [RS:0;jenkins-hbase4:46795] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 20:01:03,770 DEBUG [RS:1;jenkins-hbase4:38759] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 20:01:03,772 DEBUG [RS:0;jenkins-hbase4:46795] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 20:01:03,772 DEBUG [RS:1;jenkins-hbase4:38759] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 20:01:03,772 DEBUG [RS:0;jenkins-hbase4:46795] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 20:01:03,772 DEBUG [RS:1;jenkins-hbase4:38759] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 20:01:03,772 DEBUG [RS:0;jenkins-hbase4:46795] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 20:01:03,772 DEBUG [RS:1;jenkins-hbase4:38759] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 20:01:03,772 DEBUG [RS:2;jenkins-hbase4:33091] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 20:01:03,772 DEBUG [RS:1;jenkins-hbase4:38759] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 20:01:03,772 DEBUG [RS:2;jenkins-hbase4:33091] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 20:01:03,772 DEBUG [RS:1;jenkins-hbase4:38759] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-28 20:01:03,772 DEBUG [RS:2;jenkins-hbase4:33091] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 20:01:03,772 DEBUG [RS:1;jenkins-hbase4:38759] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 20:01:03,773 DEBUG [RS:1;jenkins-hbase4:38759] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 20:01:03,773 DEBUG [RS:1;jenkins-hbase4:38759] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 20:01:03,773 DEBUG [RS:1;jenkins-hbase4:38759] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 20:01:03,779 INFO [RS:0;jenkins-hbase4:46795] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-28 20:01:03,779 INFO [RS:0;jenkins-hbase4:46795] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-28 20:01:03,779 INFO [RS:0;jenkins-hbase4:46795] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-28 20:01:03,781 INFO [RS:2;jenkins-hbase4:33091] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-28 20:01:03,781 INFO [RS:2;jenkins-hbase4:33091] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-28 20:01:03,781 INFO [RS:2;jenkins-hbase4:33091] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-28 20:01:03,781 INFO [RS:1;jenkins-hbase4:38759] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-28 20:01:03,781 INFO [RS:1;jenkins-hbase4:38759] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-28 20:01:03,781 INFO [RS:1;jenkins-hbase4:38759] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-28 20:01:03,799 INFO [RS:0;jenkins-hbase4:46795] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-28 20:01:03,800 INFO [RS:2;jenkins-hbase4:33091] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-28 20:01:03,802 INFO [RS:1;jenkins-hbase4:38759] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-28 20:01:03,803 INFO [RS:2;jenkins-hbase4:33091] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33091,1695931262281-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-28 20:01:03,803 INFO [RS:0;jenkins-hbase4:46795] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46795,1695931262192-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-28 20:01:03,803 INFO [RS:1;jenkins-hbase4:38759] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38759,1695931262240-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-28 20:01:03,828 INFO [RS:1;jenkins-hbase4:38759] regionserver.Replication(203): jenkins-hbase4.apache.org,38759,1695931262240 started 2023-09-28 20:01:03,828 INFO [RS:0;jenkins-hbase4:46795] regionserver.Replication(203): jenkins-hbase4.apache.org,46795,1695931262192 started 2023-09-28 20:01:03,828 INFO [RS:1;jenkins-hbase4:38759] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,38759,1695931262240, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38759, sessionid=0x100f42093bb0002 2023-09-28 20:01:03,828 INFO [RS:0;jenkins-hbase4:46795] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,46795,1695931262192, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46795, sessionid=0x100f42093bb0001 2023-09-28 20:01:03,829 INFO [RS:2;jenkins-hbase4:33091] regionserver.Replication(203): jenkins-hbase4.apache.org,33091,1695931262281 started 2023-09-28 20:01:03,829 DEBUG [RS:0;jenkins-hbase4:46795] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-28 20:01:03,829 DEBUG [RS:1;jenkins-hbase4:38759] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-28 20:01:03,829 DEBUG [RS:0;jenkins-hbase4:46795] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:03,829 INFO [RS:2;jenkins-hbase4:33091] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,33091,1695931262281, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33091, sessionid=0x100f42093bb0003 2023-09-28 20:01:03,830 DEBUG [RS:0;jenkins-hbase4:46795] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46795,1695931262192' 2023-09-28 20:01:03,830 DEBUG [RS:2;jenkins-hbase4:33091] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-28 20:01:03,829 DEBUG [RS:1;jenkins-hbase4:38759] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:03,830 DEBUG [RS:2;jenkins-hbase4:33091] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:03,830 DEBUG [RS:0;jenkins-hbase4:46795] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-28 20:01:03,831 DEBUG [RS:2;jenkins-hbase4:33091] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33091,1695931262281' 2023-09-28 20:01:03,831 DEBUG [RS:2;jenkins-hbase4:33091] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-28 20:01:03,830 DEBUG [RS:1;jenkins-hbase4:38759] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38759,1695931262240' 2023-09-28 20:01:03,831 DEBUG [RS:1;jenkins-hbase4:38759] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-28 20:01:03,831 DEBUG [RS:0;jenkins-hbase4:46795] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-28 20:01:03,832 DEBUG [RS:2;jenkins-hbase4:33091] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-28 20:01:03,832 DEBUG [RS:1;jenkins-hbase4:38759] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-28 20:01:03,832 DEBUG [RS:0;jenkins-hbase4:46795] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-28 20:01:03,832 DEBUG [RS:2;jenkins-hbase4:33091] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-28 20:01:03,832 DEBUG [RS:0;jenkins-hbase4:46795] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-28 20:01:03,832 DEBUG [RS:1;jenkins-hbase4:38759] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-28 20:01:03,833 DEBUG [RS:0;jenkins-hbase4:46795] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:03,833 DEBUG [RS:1;jenkins-hbase4:38759] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-28 20:01:03,832 DEBUG [RS:2;jenkins-hbase4:33091] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-28 20:01:03,833 DEBUG [RS:1;jenkins-hbase4:38759] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:03,834 DEBUG [RS:1;jenkins-hbase4:38759] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38759,1695931262240' 2023-09-28 20:01:03,834 DEBUG [RS:1;jenkins-hbase4:38759] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:01:03,833 DEBUG [RS:0;jenkins-hbase4:46795] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46795,1695931262192' 2023-09-28 20:01:03,834 DEBUG [RS:2;jenkins-hbase4:33091] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:03,834 DEBUG [RS:2;jenkins-hbase4:33091] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33091,1695931262281' 2023-09-28 20:01:03,834 DEBUG [RS:0;jenkins-hbase4:46795] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:01:03,834 DEBUG [RS:2;jenkins-hbase4:33091] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:01:03,834 DEBUG [RS:1;jenkins-hbase4:38759] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:01:03,835 DEBUG [RS:0;jenkins-hbase4:46795] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:01:03,835 DEBUG [RS:1;jenkins-hbase4:38759] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-28 20:01:03,835 DEBUG [RS:2;jenkins-hbase4:33091] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:01:03,835 INFO [RS:1;jenkins-hbase4:38759] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-28 20:01:03,835 INFO [RS:1;jenkins-hbase4:38759] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-28 20:01:03,835 DEBUG [RS:0;jenkins-hbase4:46795] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-28 20:01:03,836 INFO [RS:0;jenkins-hbase4:46795] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-28 20:01:03,836 DEBUG [RS:2;jenkins-hbase4:33091] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-28 20:01:03,836 INFO [RS:0;jenkins-hbase4:46795] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-28 20:01:03,837 INFO [RS:2;jenkins-hbase4:33091] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-28 20:01:03,837 INFO [RS:2;jenkins-hbase4:33091] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-28 20:01:03,911 DEBUG [jenkins-hbase4:35173] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-09-28 20:01:03,916 DEBUG [jenkins-hbase4:35173] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-28 20:01:03,922 DEBUG [jenkins-hbase4:35173] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-28 20:01:03,922 DEBUG [jenkins-hbase4:35173] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-28 20:01:03,922 DEBUG [jenkins-hbase4:35173] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-28 20:01:03,922 DEBUG [jenkins-hbase4:35173] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-28 20:01:03,925 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,33091,1695931262281, state=OPENING 2023-09-28 20:01:03,932 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-09-28 20:01:03,934 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-28 20:01:03,935 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-28 20:01:03,940 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,33091,1695931262281}] 2023-09-28 20:01:03,948 INFO [RS:2;jenkins-hbase4:33091] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33091%2C1695931262281, suffix=, logDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/WALs/jenkins-hbase4.apache.org,33091,1695931262281, archiveDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/oldWALs, maxLogs=32 2023-09-28 20:01:03,948 INFO [RS:0;jenkins-hbase4:46795] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46795%2C1695931262192, suffix=, logDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/WALs/jenkins-hbase4.apache.org,46795,1695931262192, archiveDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/oldWALs, maxLogs=32 2023-09-28 20:01:03,948 INFO [RS:1;jenkins-hbase4:38759] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38759%2C1695931262240, suffix=, logDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/WALs/jenkins-hbase4.apache.org,38759,1695931262240, archiveDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/oldWALs, maxLogs=32 2023-09-28 20:01:03,987 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44003,DS-dc7d4874-542d-42b2-ad45-c0c92a30e9da,DISK] 2023-09-28 20:01:03,987 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44003,DS-dc7d4874-542d-42b2-ad45-c0c92a30e9da,DISK] 2023-09-28 20:01:03,987 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44957,DS-ad36875b-cc72-4e0b-a3d5-1104ee8961f4,DISK] 2023-09-28 20:01:03,988 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42807,DS-302719a4-3515-4307-aa76-b269f1b93555,DISK] 2023-09-28 20:01:03,988 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42807,DS-302719a4-3515-4307-aa76-b269f1b93555,DISK] 2023-09-28 20:01:03,989 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44957,DS-ad36875b-cc72-4e0b-a3d5-1104ee8961f4,DISK] 2023-09-28 20:01:03,996 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44003,DS-dc7d4874-542d-42b2-ad45-c0c92a30e9da,DISK] 2023-09-28 20:01:03,996 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42807,DS-302719a4-3515-4307-aa76-b269f1b93555,DISK] 2023-09-28 20:01:04,001 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44957,DS-ad36875b-cc72-4e0b-a3d5-1104ee8961f4,DISK] 2023-09-28 20:01:04,010 INFO [RS:1;jenkins-hbase4:38759] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/WALs/jenkins-hbase4.apache.org,38759,1695931262240/jenkins-hbase4.apache.org%2C38759%2C1695931262240.1695931263957 2023-09-28 20:01:04,016 DEBUG [RS:1;jenkins-hbase4:38759] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44957,DS-ad36875b-cc72-4e0b-a3d5-1104ee8961f4,DISK], DatanodeInfoWithStorage[127.0.0.1:44003,DS-dc7d4874-542d-42b2-ad45-c0c92a30e9da,DISK], DatanodeInfoWithStorage[127.0.0.1:42807,DS-302719a4-3515-4307-aa76-b269f1b93555,DISK]] 2023-09-28 20:01:04,016 INFO [RS:2;jenkins-hbase4:33091] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/WALs/jenkins-hbase4.apache.org,33091,1695931262281/jenkins-hbase4.apache.org%2C33091%2C1695931262281.1695931263957 2023-09-28 20:01:04,016 INFO [RS:0;jenkins-hbase4:46795] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/WALs/jenkins-hbase4.apache.org,46795,1695931262192/jenkins-hbase4.apache.org%2C46795%2C1695931262192.1695931263957 2023-09-28 20:01:04,021 DEBUG [RS:2;jenkins-hbase4:33091] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44003,DS-dc7d4874-542d-42b2-ad45-c0c92a30e9da,DISK], DatanodeInfoWithStorage[127.0.0.1:42807,DS-302719a4-3515-4307-aa76-b269f1b93555,DISK], DatanodeInfoWithStorage[127.0.0.1:44957,DS-ad36875b-cc72-4e0b-a3d5-1104ee8961f4,DISK]] 2023-09-28 20:01:04,021 DEBUG [RS:0;jenkins-hbase4:46795] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44003,DS-dc7d4874-542d-42b2-ad45-c0c92a30e9da,DISK], DatanodeInfoWithStorage[127.0.0.1:42807,DS-302719a4-3515-4307-aa76-b269f1b93555,DISK], DatanodeInfoWithStorage[127.0.0.1:44957,DS-ad36875b-cc72-4e0b-a3d5-1104ee8961f4,DISK]] 2023-09-28 20:01:04,133 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:04,136 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-28 20:01:04,139 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41342, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-28 20:01:04,157 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-09-28 20:01:04,158 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-28 20:01:04,162 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33091%2C1695931262281.meta, suffix=.meta, logDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/WALs/jenkins-hbase4.apache.org,33091,1695931262281, archiveDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/oldWALs, maxLogs=32 2023-09-28 20:01:04,183 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42807,DS-302719a4-3515-4307-aa76-b269f1b93555,DISK] 2023-09-28 20:01:04,184 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44957,DS-ad36875b-cc72-4e0b-a3d5-1104ee8961f4,DISK] 2023-09-28 20:01:04,186 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44003,DS-dc7d4874-542d-42b2-ad45-c0c92a30e9da,DISK] 2023-09-28 20:01:04,199 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/WALs/jenkins-hbase4.apache.org,33091,1695931262281/jenkins-hbase4.apache.org%2C33091%2C1695931262281.meta.1695931264163.meta 2023-09-28 20:01:04,199 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42807,DS-302719a4-3515-4307-aa76-b269f1b93555,DISK], DatanodeInfoWithStorage[127.0.0.1:44957,DS-ad36875b-cc72-4e0b-a3d5-1104ee8961f4,DISK], DatanodeInfoWithStorage[127.0.0.1:44003,DS-dc7d4874-542d-42b2-ad45-c0c92a30e9da,DISK]] 2023-09-28 20:01:04,200 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-09-28 20:01:04,201 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-09-28 20:01:04,202 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 20:01:04,203 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-09-28 20:01:04,205 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-09-28 20:01:04,207 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-09-28 20:01:04,220 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-09-28 20:01:04,221 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 20:01:04,221 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-09-28 20:01:04,221 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-09-28 20:01:04,224 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-28 20:01:04,226 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/hbase/meta/1588230740/info 2023-09-28 20:01:04,226 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/hbase/meta/1588230740/info 2023-09-28 20:01:04,227 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-28 20:01:04,228 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 20:01:04,228 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-28 20:01:04,229 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/hbase/meta/1588230740/rep_barrier 2023-09-28 20:01:04,229 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/hbase/meta/1588230740/rep_barrier 2023-09-28 20:01:04,230 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-28 20:01:04,231 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 20:01:04,231 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-28 20:01:04,233 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/hbase/meta/1588230740/table 2023-09-28 20:01:04,233 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/hbase/meta/1588230740/table 2023-09-28 20:01:04,233 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-28 20:01:04,234 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 20:01:04,236 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/hbase/meta/1588230740 2023-09-28 20:01:04,239 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/hbase/meta/1588230740 2023-09-28 20:01:04,242 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-28 20:01:04,246 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-28 20:01:04,250 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70991657, jitterRate=0.05785812437534332}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-28 20:01:04,254 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-28 20:01:04,268 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1695931264125 2023-09-28 20:01:04,290 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-09-28 20:01:04,291 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-09-28 20:01:04,292 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,33091,1695931262281, state=OPEN 2023-09-28 20:01:04,296 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-09-28 20:01:04,296 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-28 20:01:04,300 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-09-28 20:01:04,301 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,33091,1695931262281 in 357 msec 2023-09-28 20:01:04,306 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-09-28 20:01:04,306 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 572 msec 2023-09-28 20:01:04,312 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 880 msec 2023-09-28 20:01:04,313 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1695931264313, completionTime=-1 2023-09-28 20:01:04,313 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-09-28 20:01:04,313 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-09-28 20:01:04,389 DEBUG [hconnection-0x1dd01c2f-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 20:01:04,392 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41346, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 20:01:04,414 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-09-28 20:01:04,415 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1695931324415 2023-09-28 20:01:04,415 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1695931384415 2023-09-28 20:01:04,415 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 101 msec 2023-09-28 20:01:04,440 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35173,1695931260872-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-28 20:01:04,441 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35173,1695931260872-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-28 20:01:04,441 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35173,1695931260872-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-28 20:01:04,444 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:35173, period=300000, unit=MILLISECONDS is enabled. 2023-09-28 20:01:04,444 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-09-28 20:01:04,457 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-09-28 20:01:04,467 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-09-28 20:01:04,468 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-28 20:01:04,479 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-09-28 20:01:04,482 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-09-28 20:01:04,486 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-28 20:01:04,512 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/hbase/namespace/48b47cf85185d27ccab02c8aa249b389 2023-09-28 20:01:04,515 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/hbase/namespace/48b47cf85185d27ccab02c8aa249b389 empty. 2023-09-28 20:01:04,516 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/hbase/namespace/48b47cf85185d27ccab02c8aa249b389 2023-09-28 20:01:04,516 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-09-28 20:01:04,558 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-09-28 20:01:04,562 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 48b47cf85185d27ccab02c8aa249b389, NAME => 'hbase:namespace,,1695931264468.48b47cf85185d27ccab02c8aa249b389.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp 2023-09-28 20:01:04,580 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695931264468.48b47cf85185d27ccab02c8aa249b389.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 20:01:04,581 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 48b47cf85185d27ccab02c8aa249b389, disabling compactions & flushes 2023-09-28 20:01:04,581 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695931264468.48b47cf85185d27ccab02c8aa249b389. 2023-09-28 20:01:04,581 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695931264468.48b47cf85185d27ccab02c8aa249b389. 2023-09-28 20:01:04,581 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695931264468.48b47cf85185d27ccab02c8aa249b389. after waiting 0 ms 2023-09-28 20:01:04,581 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695931264468.48b47cf85185d27ccab02c8aa249b389. 2023-09-28 20:01:04,581 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695931264468.48b47cf85185d27ccab02c8aa249b389. 2023-09-28 20:01:04,581 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 48b47cf85185d27ccab02c8aa249b389: 2023-09-28 20:01:04,586 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-09-28 20:01:04,602 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1695931264468.48b47cf85185d27ccab02c8aa249b389.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695931264589"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695931264589"}]},"ts":"1695931264589"} 2023-09-28 20:01:04,630 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-28 20:01:04,632 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-28 20:01:04,637 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695931264633"}]},"ts":"1695931264633"} 2023-09-28 20:01:04,642 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-09-28 20:01:04,651 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-28 20:01:04,652 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-28 20:01:04,652 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-28 20:01:04,652 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-28 20:01:04,653 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-28 20:01:04,655 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=48b47cf85185d27ccab02c8aa249b389, ASSIGN}] 2023-09-28 20:01:04,659 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=48b47cf85185d27ccab02c8aa249b389, ASSIGN 2023-09-28 20:01:04,662 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=48b47cf85185d27ccab02c8aa249b389, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46795,1695931262192; forceNewPlan=false, retain=false 2023-09-28 20:01:04,814 INFO [jenkins-hbase4:35173] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-28 20:01:04,815 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=48b47cf85185d27ccab02c8aa249b389, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:04,815 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1695931264468.48b47cf85185d27ccab02c8aa249b389.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695931264815"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695931264815"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695931264815"}]},"ts":"1695931264815"} 2023-09-28 20:01:04,821 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 48b47cf85185d27ccab02c8aa249b389, server=jenkins-hbase4.apache.org,46795,1695931262192}] 2023-09-28 20:01:04,976 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:04,976 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-28 20:01:04,979 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51512, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-28 20:01:04,985 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1695931264468.48b47cf85185d27ccab02c8aa249b389. 2023-09-28 20:01:04,985 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 48b47cf85185d27ccab02c8aa249b389, NAME => 'hbase:namespace,,1695931264468.48b47cf85185d27ccab02c8aa249b389.', STARTKEY => '', ENDKEY => ''} 2023-09-28 20:01:04,985 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1695931264468.48b47cf85185d27ccab02c8aa249b389. service=AccessControlService 2023-09-28 20:01:04,986 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 20:01:04,987 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 48b47cf85185d27ccab02c8aa249b389 2023-09-28 20:01:04,987 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695931264468.48b47cf85185d27ccab02c8aa249b389.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 20:01:04,987 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 48b47cf85185d27ccab02c8aa249b389 2023-09-28 20:01:04,987 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 48b47cf85185d27ccab02c8aa249b389 2023-09-28 20:01:04,989 INFO [StoreOpener-48b47cf85185d27ccab02c8aa249b389-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 48b47cf85185d27ccab02c8aa249b389 2023-09-28 20:01:04,991 DEBUG [StoreOpener-48b47cf85185d27ccab02c8aa249b389-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/hbase/namespace/48b47cf85185d27ccab02c8aa249b389/info 2023-09-28 20:01:04,992 DEBUG [StoreOpener-48b47cf85185d27ccab02c8aa249b389-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/hbase/namespace/48b47cf85185d27ccab02c8aa249b389/info 2023-09-28 20:01:04,992 INFO [StoreOpener-48b47cf85185d27ccab02c8aa249b389-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 48b47cf85185d27ccab02c8aa249b389 columnFamilyName info 2023-09-28 20:01:04,993 INFO [StoreOpener-48b47cf85185d27ccab02c8aa249b389-1] regionserver.HStore(310): Store=48b47cf85185d27ccab02c8aa249b389/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 20:01:04,995 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/hbase/namespace/48b47cf85185d27ccab02c8aa249b389 2023-09-28 20:01:04,996 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/hbase/namespace/48b47cf85185d27ccab02c8aa249b389 2023-09-28 20:01:05,000 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 48b47cf85185d27ccab02c8aa249b389 2023-09-28 20:01:05,004 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/hbase/namespace/48b47cf85185d27ccab02c8aa249b389/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 20:01:05,005 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 48b47cf85185d27ccab02c8aa249b389; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60566215, jitterRate=-0.09749306738376617}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 20:01:05,005 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 48b47cf85185d27ccab02c8aa249b389: 2023-09-28 20:01:05,009 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1695931264468.48b47cf85185d27ccab02c8aa249b389., pid=6, masterSystemTime=1695931264975 2023-09-28 20:01:05,014 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1695931264468.48b47cf85185d27ccab02c8aa249b389. 2023-09-28 20:01:05,014 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1695931264468.48b47cf85185d27ccab02c8aa249b389. 2023-09-28 20:01:05,016 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=48b47cf85185d27ccab02c8aa249b389, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:05,017 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1695931264468.48b47cf85185d27ccab02c8aa249b389.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695931265016"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695931265016"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695931265016"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695931265016"}]},"ts":"1695931265016"} 2023-09-28 20:01:05,024 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-09-28 20:01:05,024 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 48b47cf85185d27ccab02c8aa249b389, server=jenkins-hbase4.apache.org,46795,1695931262192 in 199 msec 2023-09-28 20:01:05,028 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-09-28 20:01:05,029 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=48b47cf85185d27ccab02c8aa249b389, ASSIGN in 369 msec 2023-09-28 20:01:05,030 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-28 20:01:05,031 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695931265031"}]},"ts":"1695931265031"} 2023-09-28 20:01:05,033 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-09-28 20:01:05,037 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-09-28 20:01:05,040 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 568 msec 2023-09-28 20:01:05,083 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-09-28 20:01:05,084 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-09-28 20:01:05,084 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-28 20:01:05,108 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 20:01:05,112 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51528, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 20:01:05,131 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-09-28 20:01:05,149 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-28 20:01:05,157 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 38 msec 2023-09-28 20:01:05,165 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-09-28 20:01:05,178 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-28 20:01:05,183 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-09-28 20:01:05,192 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-09-28 20:01:05,195 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-09-28 20:01:05,197 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.843sec 2023-09-28 20:01:05,200 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-09-28 20:01:05,202 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-09-28 20:01:05,202 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-09-28 20:01:05,203 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35173,1695931260872-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-09-28 20:01:05,204 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35173,1695931260872-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-09-28 20:01:05,218 DEBUG [Listener at localhost/38989] zookeeper.ReadOnlyZKClient(139): Connect 0x627146cd to 127.0.0.1:50329 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 20:01:05,224 DEBUG [Listener at localhost/38989] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@cba4ac7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 20:01:05,232 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-28 20:01:05,234 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-09-28 20:01:05,238 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-09-28 20:01:05,240 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-28 20:01:05,241 DEBUG [hconnection-0x1eb93e1b-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 20:01:05,243 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/hbase/acl/a53080a21eb6cd483bc926ad9302320f 2023-09-28 20:01:05,244 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-09-28 20:01:05,245 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/hbase/acl/a53080a21eb6cd483bc926ad9302320f empty. 2023-09-28 20:01:05,248 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/hbase/acl/a53080a21eb6cd483bc926ad9302320f 2023-09-28 20:01:05,248 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-09-28 20:01:05,258 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-28 20:01:05,259 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41356, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 20:01:05,262 INFO [Listener at localhost/38989] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,35173,1695931260872 2023-09-28 20:01:05,262 INFO [Listener at localhost/38989] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-09-28 20:01:05,262 INFO [Listener at localhost/38989] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/test.cache.data in system properties and HBase conf 2023-09-28 20:01:05,262 INFO [Listener at localhost/38989] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/hadoop.tmp.dir in system properties and HBase conf 2023-09-28 20:01:05,262 INFO [Listener at localhost/38989] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/hadoop.log.dir in system properties and HBase conf 2023-09-28 20:01:05,262 INFO [Listener at localhost/38989] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-28 20:01:05,263 INFO [Listener at localhost/38989] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-28 20:01:05,263 INFO [Listener at localhost/38989] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-28 20:01:05,263 INFO [Listener at localhost/38989] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-28 20:01:05,263 INFO [Listener at localhost/38989] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-28 20:01:05,263 INFO [Listener at localhost/38989] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-28 20:01:05,263 INFO [Listener at localhost/38989] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-28 20:01:05,263 INFO [Listener at localhost/38989] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-28 20:01:05,263 INFO [Listener at localhost/38989] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-28 20:01:05,263 INFO [Listener at localhost/38989] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-28 20:01:05,263 INFO [Listener at localhost/38989] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-28 20:01:05,263 INFO [Listener at localhost/38989] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-28 20:01:05,263 INFO [Listener at localhost/38989] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/nfs.dump.dir in system properties and HBase conf 2023-09-28 20:01:05,263 INFO [Listener at localhost/38989] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/java.io.tmpdir in system properties and HBase conf 2023-09-28 20:01:05,263 INFO [Listener at localhost/38989] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-28 20:01:05,264 INFO [Listener at localhost/38989] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-28 20:01:05,264 INFO [Listener at localhost/38989] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-09-28 20:01:05,282 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-09-28 20:01:05,287 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => a53080a21eb6cd483bc926ad9302320f, NAME => 'hbase:acl,,1695931265224.a53080a21eb6cd483bc926ad9302320f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp 2023-09-28 20:01:05,310 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695931265224.a53080a21eb6cd483bc926ad9302320f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 20:01:05,310 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing a53080a21eb6cd483bc926ad9302320f, disabling compactions & flushes 2023-09-28 20:01:05,310 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695931265224.a53080a21eb6cd483bc926ad9302320f. 2023-09-28 20:01:05,310 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695931265224.a53080a21eb6cd483bc926ad9302320f. 2023-09-28 20:01:05,310 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695931265224.a53080a21eb6cd483bc926ad9302320f. after waiting 0 ms 2023-09-28 20:01:05,311 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695931265224.a53080a21eb6cd483bc926ad9302320f. 2023-09-28 20:01:05,311 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1695931265224.a53080a21eb6cd483bc926ad9302320f. 2023-09-28 20:01:05,311 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for a53080a21eb6cd483bc926ad9302320f: 2023-09-28 20:01:05,316 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-09-28 20:01:05,318 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1695931265224.a53080a21eb6cd483bc926ad9302320f.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695931265318"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695931265318"}]},"ts":"1695931265318"} 2023-09-28 20:01:05,322 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-28 20:01:05,324 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-28 20:01:05,324 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695931265324"}]},"ts":"1695931265324"} 2023-09-28 20:01:05,327 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-09-28 20:01:05,332 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-28 20:01:05,334 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-28 20:01:05,334 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-28 20:01:05,334 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-28 20:01:05,334 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-28 20:01:05,334 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=a53080a21eb6cd483bc926ad9302320f, ASSIGN}] 2023-09-28 20:01:05,340 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=a53080a21eb6cd483bc926ad9302320f, ASSIGN 2023-09-28 20:01:05,346 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=a53080a21eb6cd483bc926ad9302320f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33091,1695931262281; forceNewPlan=false, retain=false 2023-09-28 20:01:05,362 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-28 20:01:05,496 INFO [jenkins-hbase4:35173] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-28 20:01:05,497 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=a53080a21eb6cd483bc926ad9302320f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:05,498 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1695931265224.a53080a21eb6cd483bc926ad9302320f.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695931265497"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695931265497"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695931265497"}]},"ts":"1695931265497"} 2023-09-28 20:01:05,501 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure a53080a21eb6cd483bc926ad9302320f, server=jenkins-hbase4.apache.org,33091,1695931262281}] 2023-09-28 20:01:05,563 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-28 20:01:05,663 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1695931265224.a53080a21eb6cd483bc926ad9302320f. 2023-09-28 20:01:05,663 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a53080a21eb6cd483bc926ad9302320f, NAME => 'hbase:acl,,1695931265224.a53080a21eb6cd483bc926ad9302320f.', STARTKEY => '', ENDKEY => ''} 2023-09-28 20:01:05,664 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1695931265224.a53080a21eb6cd483bc926ad9302320f. service=AccessControlService 2023-09-28 20:01:05,664 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 20:01:05,664 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl a53080a21eb6cd483bc926ad9302320f 2023-09-28 20:01:05,664 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695931265224.a53080a21eb6cd483bc926ad9302320f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 20:01:05,664 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a53080a21eb6cd483bc926ad9302320f 2023-09-28 20:01:05,664 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a53080a21eb6cd483bc926ad9302320f 2023-09-28 20:01:05,667 INFO [StoreOpener-a53080a21eb6cd483bc926ad9302320f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region a53080a21eb6cd483bc926ad9302320f 2023-09-28 20:01:05,670 DEBUG [StoreOpener-a53080a21eb6cd483bc926ad9302320f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/hbase/acl/a53080a21eb6cd483bc926ad9302320f/l 2023-09-28 20:01:05,670 DEBUG [StoreOpener-a53080a21eb6cd483bc926ad9302320f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/hbase/acl/a53080a21eb6cd483bc926ad9302320f/l 2023-09-28 20:01:05,670 INFO [StoreOpener-a53080a21eb6cd483bc926ad9302320f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a53080a21eb6cd483bc926ad9302320f columnFamilyName l 2023-09-28 20:01:05,672 INFO [StoreOpener-a53080a21eb6cd483bc926ad9302320f-1] regionserver.HStore(310): Store=a53080a21eb6cd483bc926ad9302320f/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 20:01:05,674 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/hbase/acl/a53080a21eb6cd483bc926ad9302320f 2023-09-28 20:01:05,676 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/hbase/acl/a53080a21eb6cd483bc926ad9302320f 2023-09-28 20:01:05,681 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a53080a21eb6cd483bc926ad9302320f 2023-09-28 20:01:05,686 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/hbase/acl/a53080a21eb6cd483bc926ad9302320f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 20:01:05,686 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a53080a21eb6cd483bc926ad9302320f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74954766, jitterRate=0.11691305041313171}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 20:01:05,687 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a53080a21eb6cd483bc926ad9302320f: 2023-09-28 20:01:05,688 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1695931265224.a53080a21eb6cd483bc926ad9302320f., pid=11, masterSystemTime=1695931265655 2023-09-28 20:01:05,691 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1695931265224.a53080a21eb6cd483bc926ad9302320f. 2023-09-28 20:01:05,692 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1695931265224.a53080a21eb6cd483bc926ad9302320f. 2023-09-28 20:01:05,693 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=a53080a21eb6cd483bc926ad9302320f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:05,693 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1695931265224.a53080a21eb6cd483bc926ad9302320f.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695931265693"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695931265693"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695931265693"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695931265693"}]},"ts":"1695931265693"} 2023-09-28 20:01:05,700 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-09-28 20:01:05,700 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure a53080a21eb6cd483bc926ad9302320f, server=jenkins-hbase4.apache.org,33091,1695931262281 in 195 msec 2023-09-28 20:01:05,706 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-09-28 20:01:05,706 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=a53080a21eb6cd483bc926ad9302320f, ASSIGN in 366 msec 2023-09-28 20:01:05,707 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-28 20:01:05,708 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695931265707"}]},"ts":"1695931265707"} 2023-09-28 20:01:05,710 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-09-28 20:01:05,714 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-09-28 20:01:05,718 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 482 msec 2023-09-28 20:01:05,863 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-28 20:01:05,864 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-09-28 20:01:05,875 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-09-28 20:01:06,596 WARN [Thread-384] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-28 20:01:06,966 INFO [Thread-384] log.Slf4jLog(67): jetty-6.1.26 2023-09-28 20:01:06,972 INFO [Thread-384] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_44719_jobhistory____4wsruw/webapp 2023-09-28 20:01:07,147 INFO [Thread-384] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-09-28 20:01:07,147 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-09-28 20:01:07,147 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-28 20:01:07,150 INFO [Thread-384] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-28 20:01:07,238 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-28 20:01:07,563 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-28 20:01:07,839 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-09-28 20:01:07,876 INFO [Thread-384] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:44719 2023-09-28 20:01:08,083 WARN [Listener at jenkins-hbase4.apache.org/36271] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-28 20:01:08,368 WARN [Listener at jenkins-hbase4.apache.org/36271] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-28 20:01:08,368 INFO [Listener at jenkins-hbase4.apache.org/36271] log.Slf4jLog(67): jetty-6.1.26 2023-09-28 20:01:08,376 INFO [Listener at jenkins-hbase4.apache.org/36271] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_35811_cluster____ucb12m/webapp 2023-09-28 20:01:08,448 INFO [Listener at jenkins-hbase4.apache.org/36271] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-09-28 20:01:08,449 INFO [Listener at jenkins-hbase4.apache.org/36271] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-09-28 20:01:08,449 INFO [Listener at jenkins-hbase4.apache.org/36271] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-28 20:01:08,449 INFO [Listener at jenkins-hbase4.apache.org/36271] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-28 20:01:08,458 INFO [Listener at jenkins-hbase4.apache.org/36271] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-28 20:01:08,682 INFO [Listener at jenkins-hbase4.apache.org/36271] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-28 20:01:08,764 INFO [Listener at jenkins-hbase4.apache.org/36271] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-28 20:01:08,771 INFO [Listener at jenkins-hbase4.apache.org/36271] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:35811 2023-09-28 20:01:09,313 WARN [Listener at jenkins-hbase4.apache.org/42501] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-28 20:01:09,339 WARN [Listener at jenkins-hbase4.apache.org/42501] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-28 20:01:09,340 INFO [Listener at jenkins-hbase4.apache.org/42501] log.Slf4jLog(67): jetty-6.1.26 2023-09-28 20:01:09,348 INFO [Listener at jenkins-hbase4.apache.org/42501] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_43521_node____abuqvn/webapp 2023-09-28 20:01:09,401 INFO [Listener at jenkins-hbase4.apache.org/42501] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-28 20:01:09,401 INFO [Listener at jenkins-hbase4.apache.org/42501] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-28 20:01:09,401 INFO [Listener at jenkins-hbase4.apache.org/42501] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-28 20:01:09,401 INFO [Listener at jenkins-hbase4.apache.org/42501] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-28 20:01:09,410 INFO [Listener at jenkins-hbase4.apache.org/42501] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-28 20:01:09,431 INFO [Listener at jenkins-hbase4.apache.org/42501] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-28 20:01:09,516 INFO [Listener at jenkins-hbase4.apache.org/42501] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-28 20:01:09,531 INFO [Listener at jenkins-hbase4.apache.org/42501] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:43521 2023-09-28 20:01:09,726 WARN [Listener at jenkins-hbase4.apache.org/41509] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-28 20:01:09,733 WARN [Listener at jenkins-hbase4.apache.org/41509] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-28 20:01:09,734 INFO [Listener at jenkins-hbase4.apache.org/41509] log.Slf4jLog(67): jetty-6.1.26 2023-09-28 20:01:09,742 INFO [Listener at jenkins-hbase4.apache.org/41509] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_39737_node____.ye7f1/webapp 2023-09-28 20:01:09,781 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-28 20:01:09,811 INFO [Listener at jenkins-hbase4.apache.org/41509] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-28 20:01:09,813 INFO [Listener at jenkins-hbase4.apache.org/41509] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-28 20:01:09,813 INFO [Listener at jenkins-hbase4.apache.org/41509] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-28 20:01:09,813 INFO [Listener at jenkins-hbase4.apache.org/41509] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-28 20:01:09,832 INFO [Listener at jenkins-hbase4.apache.org/41509] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-28 20:01:09,855 INFO [Listener at jenkins-hbase4.apache.org/41509] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-28 20:01:09,938 INFO [Listener at jenkins-hbase4.apache.org/41509] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-28 20:01:09,950 INFO [Listener at jenkins-hbase4.apache.org/41509] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:39737 2023-09-28 20:01:09,967 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-09-28 20:01:09,973 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-09-28 20:01:09,974 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-09-28 20:01:09,987 INFO [Listener at jenkins-hbase4.apache.org/41509] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-09-28 20:01:09,989 INFO [Listener at jenkins-hbase4.apache.org/41509] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-09-28 20:01:10,060 INFO [Listener at jenkins-hbase4.apache.org/41509] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=707, OpenFileDescriptor=900, MaxFileDescriptor=60000, SystemLoadAverage=166, ProcessCount=165, AvailableMemoryMB=5646 2023-09-28 20:01:10,061 WARN [Listener at jenkins-hbase4.apache.org/41509] hbase.ResourceChecker(130): Thread=707 is superior to 500 2023-09-28 20:01:10,075 DEBUG [Listener at jenkins-hbase4.apache.org/41509] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-09-28 20:01:10,080 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40032, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-09-28 20:01:10,087 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-28 20:01:10,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-09-28 20:01:10,092 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-09-28 20:01:10,093 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-09-28 20:01:10,095 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-28 20:01:10,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-28 20:01:10,100 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportWithTargetName/b2c86ecab66cb236a12767a0bf81f815 2023-09-28 20:01:10,100 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportWithTargetName/0a41e8360b39e45516212d158359f349 2023-09-28 20:01:10,102 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportWithTargetName/b2c86ecab66cb236a12767a0bf81f815 empty. 2023-09-28 20:01:10,102 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportWithTargetName/0a41e8360b39e45516212d158359f349 empty. 2023-09-28 20:01:10,103 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportWithTargetName/b2c86ecab66cb236a12767a0bf81f815 2023-09-28 20:01:10,103 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportWithTargetName/0a41e8360b39e45516212d158359f349 2023-09-28 20:01:10,103 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-28 20:01:10,139 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-09-28 20:01:10,141 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => b2c86ecab66cb236a12767a0bf81f815, NAME => 'testtb-testExportWithTargetName,,1695931270086.b2c86ecab66cb236a12767a0bf81f815.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp 2023-09-28 20:01:10,141 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0a41e8360b39e45516212d158359f349, NAME => 'testtb-testExportWithTargetName,1,1695931270086.0a41e8360b39e45516212d158359f349.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp 2023-09-28 20:01:10,185 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695931270086.b2c86ecab66cb236a12767a0bf81f815.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 20:01:10,186 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing b2c86ecab66cb236a12767a0bf81f815, disabling compactions & flushes 2023-09-28 20:01:10,186 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695931270086.b2c86ecab66cb236a12767a0bf81f815. 2023-09-28 20:01:10,186 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695931270086.b2c86ecab66cb236a12767a0bf81f815. 2023-09-28 20:01:10,186 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695931270086.b2c86ecab66cb236a12767a0bf81f815. after waiting 0 ms 2023-09-28 20:01:10,186 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695931270086.b2c86ecab66cb236a12767a0bf81f815. 2023-09-28 20:01:10,186 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695931270086.b2c86ecab66cb236a12767a0bf81f815. 2023-09-28 20:01:10,186 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695931270086.0a41e8360b39e45516212d158359f349.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 20:01:10,186 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for b2c86ecab66cb236a12767a0bf81f815: 2023-09-28 20:01:10,187 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 0a41e8360b39e45516212d158359f349, disabling compactions & flushes 2023-09-28 20:01:10,187 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695931270086.0a41e8360b39e45516212d158359f349. 2023-09-28 20:01:10,187 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695931270086.0a41e8360b39e45516212d158359f349. 2023-09-28 20:01:10,187 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695931270086.0a41e8360b39e45516212d158359f349. after waiting 0 ms 2023-09-28 20:01:10,187 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695931270086.0a41e8360b39e45516212d158359f349. 2023-09-28 20:01:10,187 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695931270086.0a41e8360b39e45516212d158359f349. 2023-09-28 20:01:10,187 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 0a41e8360b39e45516212d158359f349: 2023-09-28 20:01:10,191 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-09-28 20:01:10,192 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695931270086.b2c86ecab66cb236a12767a0bf81f815.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695931270192"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695931270192"}]},"ts":"1695931270192"} 2023-09-28 20:01:10,192 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695931270086.0a41e8360b39e45516212d158359f349.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695931270192"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695931270192"}]},"ts":"1695931270192"} 2023-09-28 20:01:10,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-28 20:01:10,242 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-28 20:01:10,244 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-28 20:01:10,244 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695931270244"}]},"ts":"1695931270244"} 2023-09-28 20:01:10,246 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-09-28 20:01:10,252 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-28 20:01:10,254 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-28 20:01:10,254 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-28 20:01:10,254 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-28 20:01:10,254 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-28 20:01:10,255 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b2c86ecab66cb236a12767a0bf81f815, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0a41e8360b39e45516212d158359f349, ASSIGN}] 2023-09-28 20:01:10,258 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b2c86ecab66cb236a12767a0bf81f815, ASSIGN 2023-09-28 20:01:10,258 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0a41e8360b39e45516212d158359f349, ASSIGN 2023-09-28 20:01:10,260 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b2c86ecab66cb236a12767a0bf81f815, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38759,1695931262240; forceNewPlan=false, retain=false 2023-09-28 20:01:10,261 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0a41e8360b39e45516212d158359f349, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46795,1695931262192; forceNewPlan=false, retain=false 2023-09-28 20:01:10,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-28 20:01:10,411 INFO [jenkins-hbase4:35173] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-28 20:01:10,414 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=0a41e8360b39e45516212d158359f349, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:10,414 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=b2c86ecab66cb236a12767a0bf81f815, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:10,414 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695931270086.0a41e8360b39e45516212d158359f349.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695931270414"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695931270414"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695931270414"}]},"ts":"1695931270414"} 2023-09-28 20:01:10,414 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695931270086.b2c86ecab66cb236a12767a0bf81f815.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695931270414"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695931270414"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695931270414"}]},"ts":"1695931270414"} 2023-09-28 20:01:10,417 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 0a41e8360b39e45516212d158359f349, server=jenkins-hbase4.apache.org,46795,1695931262192}] 2023-09-28 20:01:10,419 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure b2c86ecab66cb236a12767a0bf81f815, server=jenkins-hbase4.apache.org,38759,1695931262240}] 2023-09-28 20:01:10,573 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:10,573 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-28 20:01:10,578 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41412, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-28 20:01:10,584 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1695931270086.0a41e8360b39e45516212d158359f349. 2023-09-28 20:01:10,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0a41e8360b39e45516212d158359f349, NAME => 'testtb-testExportWithTargetName,1,1695931270086.0a41e8360b39e45516212d158359f349.', STARTKEY => '1', ENDKEY => ''} 2023-09-28 20:01:10,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1695931270086.0a41e8360b39e45516212d158359f349. service=AccessControlService 2023-09-28 20:01:10,585 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 20:01:10,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 0a41e8360b39e45516212d158359f349 2023-09-28 20:01:10,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695931270086.0a41e8360b39e45516212d158359f349.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 20:01:10,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0a41e8360b39e45516212d158359f349 2023-09-28 20:01:10,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0a41e8360b39e45516212d158359f349 2023-09-28 20:01:10,587 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1695931270086.b2c86ecab66cb236a12767a0bf81f815. 2023-09-28 20:01:10,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b2c86ecab66cb236a12767a0bf81f815, NAME => 'testtb-testExportWithTargetName,,1695931270086.b2c86ecab66cb236a12767a0bf81f815.', STARTKEY => '', ENDKEY => '1'} 2023-09-28 20:01:10,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1695931270086.b2c86ecab66cb236a12767a0bf81f815. service=AccessControlService 2023-09-28 20:01:10,588 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 20:01:10,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName b2c86ecab66cb236a12767a0bf81f815 2023-09-28 20:01:10,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695931270086.b2c86ecab66cb236a12767a0bf81f815.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 20:01:10,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b2c86ecab66cb236a12767a0bf81f815 2023-09-28 20:01:10,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b2c86ecab66cb236a12767a0bf81f815 2023-09-28 20:01:10,590 INFO [StoreOpener-0a41e8360b39e45516212d158359f349-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0a41e8360b39e45516212d158359f349 2023-09-28 20:01:10,590 INFO [StoreOpener-b2c86ecab66cb236a12767a0bf81f815-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b2c86ecab66cb236a12767a0bf81f815 2023-09-28 20:01:10,593 DEBUG [StoreOpener-0a41e8360b39e45516212d158359f349-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportWithTargetName/0a41e8360b39e45516212d158359f349/cf 2023-09-28 20:01:10,593 DEBUG [StoreOpener-0a41e8360b39e45516212d158359f349-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportWithTargetName/0a41e8360b39e45516212d158359f349/cf 2023-09-28 20:01:10,593 DEBUG [StoreOpener-b2c86ecab66cb236a12767a0bf81f815-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportWithTargetName/b2c86ecab66cb236a12767a0bf81f815/cf 2023-09-28 20:01:10,593 DEBUG [StoreOpener-b2c86ecab66cb236a12767a0bf81f815-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportWithTargetName/b2c86ecab66cb236a12767a0bf81f815/cf 2023-09-28 20:01:10,597 INFO [StoreOpener-b2c86ecab66cb236a12767a0bf81f815-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b2c86ecab66cb236a12767a0bf81f815 columnFamilyName cf 2023-09-28 20:01:10,597 INFO [StoreOpener-0a41e8360b39e45516212d158359f349-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0a41e8360b39e45516212d158359f349 columnFamilyName cf 2023-09-28 20:01:10,601 INFO [StoreOpener-0a41e8360b39e45516212d158359f349-1] regionserver.HStore(310): Store=0a41e8360b39e45516212d158359f349/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 20:01:10,601 INFO [StoreOpener-b2c86ecab66cb236a12767a0bf81f815-1] regionserver.HStore(310): Store=b2c86ecab66cb236a12767a0bf81f815/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 20:01:10,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportWithTargetName/b2c86ecab66cb236a12767a0bf81f815 2023-09-28 20:01:10,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportWithTargetName/0a41e8360b39e45516212d158359f349 2023-09-28 20:01:10,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportWithTargetName/b2c86ecab66cb236a12767a0bf81f815 2023-09-28 20:01:10,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportWithTargetName/0a41e8360b39e45516212d158359f349 2023-09-28 20:01:10,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b2c86ecab66cb236a12767a0bf81f815 2023-09-28 20:01:10,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0a41e8360b39e45516212d158359f349 2023-09-28 20:01:10,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportWithTargetName/b2c86ecab66cb236a12767a0bf81f815/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 20:01:10,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportWithTargetName/0a41e8360b39e45516212d158359f349/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 20:01:10,622 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b2c86ecab66cb236a12767a0bf81f815; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71015964, jitterRate=0.05822032690048218}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 20:01:10,622 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0a41e8360b39e45516212d158359f349; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74255249, jitterRate=0.10648943483829498}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 20:01:10,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b2c86ecab66cb236a12767a0bf81f815: 2023-09-28 20:01:10,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0a41e8360b39e45516212d158359f349: 2023-09-28 20:01:10,623 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1695931270086.0a41e8360b39e45516212d158359f349., pid=15, masterSystemTime=1695931270570 2023-09-28 20:01:10,623 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1695931270086.b2c86ecab66cb236a12767a0bf81f815., pid=16, masterSystemTime=1695931270573 2023-09-28 20:01:10,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1695931270086.0a41e8360b39e45516212d158359f349. 2023-09-28 20:01:10,630 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1695931270086.0a41e8360b39e45516212d158359f349. 2023-09-28 20:01:10,631 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=0a41e8360b39e45516212d158359f349, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:10,632 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1695931270086.0a41e8360b39e45516212d158359f349.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695931270631"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695931270631"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695931270631"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695931270631"}]},"ts":"1695931270631"} 2023-09-28 20:01:10,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1695931270086.b2c86ecab66cb236a12767a0bf81f815. 2023-09-28 20:01:10,634 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1695931270086.b2c86ecab66cb236a12767a0bf81f815. 2023-09-28 20:01:10,634 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=b2c86ecab66cb236a12767a0bf81f815, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:10,636 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1695931270086.b2c86ecab66cb236a12767a0bf81f815.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695931270634"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695931270634"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695931270634"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695931270634"}]},"ts":"1695931270634"} 2023-09-28 20:01:10,642 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=14 2023-09-28 20:01:10,642 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 0a41e8360b39e45516212d158359f349, server=jenkins-hbase4.apache.org,46795,1695931262192 in 221 msec 2023-09-28 20:01:10,644 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=13 2023-09-28 20:01:10,648 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure b2c86ecab66cb236a12767a0bf81f815, server=jenkins-hbase4.apache.org,38759,1695931262240 in 221 msec 2023-09-28 20:01:10,649 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0a41e8360b39e45516212d158359f349, ASSIGN in 388 msec 2023-09-28 20:01:10,653 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=13, resume processing ppid=12 2023-09-28 20:01:10,653 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b2c86ecab66cb236a12767a0bf81f815, ASSIGN in 389 msec 2023-09-28 20:01:10,654 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-28 20:01:10,655 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695931270654"}]},"ts":"1695931270654"} 2023-09-28 20:01:10,657 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-09-28 20:01:10,660 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-09-28 20:01:10,665 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-09-28 20:01:10,686 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33091] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-28 20:01:10,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-28 20:01:10,732 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-28 20:01:10,732 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-28 20:01:10,732 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-28 20:01:10,732 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-28 20:01:10,732 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-28 20:01:10,741 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-28 20:01:10,741 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-28 20:01:10,741 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-28 20:01:10,741 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-28 20:01:10,745 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 655 msec 2023-09-28 20:01:11,046 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 20:01:11,047 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-09-28 20:01:11,047 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 20:01:11,048 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-09-28 20:01:11,048 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-28 20:01:11,048 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-09-28 20:01:11,048 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 20:01:11,048 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-09-28 20:01:11,048 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-28 20:01:11,048 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-09-28 20:01:11,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-28 20:01:11,202 INFO [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-09-28 20:01:11,206 DEBUG [Listener at jenkins-hbase4.apache.org/41509] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-28 20:01:11,207 DEBUG [Listener at jenkins-hbase4.apache.org/41509] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695931270086.b2c86ecab66cb236a12767a0bf81f815. 2023-09-28 20:01:11,210 INFO [Listener at jenkins-hbase4.apache.org/41509] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-28 20:01:11,234 DEBUG [hconnection-0x1eb93e1b-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 20:01:11,240 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41416, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 20:01:11,245 DEBUG [hconnection-0x1eb93e1b-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 20:01:11,248 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57490, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 20:01:11,265 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-28 20:01:11,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695931271265 (current time:1695931271265). 2023-09-28 20:01:11,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-28 20:01:11,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] zookeeper.ReadOnlyZKClient(139): Connect 0x261f74a0 to 127.0.0.1:50329 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 20:01:11,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@16fbdb83, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 20:01:11,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 20:01:11,319 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32774, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 20:01:11,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x261f74a0 to 127.0.0.1:50329 2023-09-28 20:01:11,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 20:01:11,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] zookeeper.ReadOnlyZKClient(139): Connect 0x76e268ab to 127.0.0.1:50329 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 20:01:11,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@547b3367, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 20:01:11,339 DEBUG [hconnection-0x65ecdeba-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 20:01:11,341 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32790, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 20:01:11,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x76e268ab to 127.0.0.1:50329 2023-09-28 20:01:11,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 20:01:11,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-28 20:01:11,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-28 20:01:11,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-28 20:01:11,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-28 20:01:11,405 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-28 20:01:11,406 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695931871406 2023-09-28 20:01:11,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-28 20:01:11,406 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-28 20:01:11,410 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-28 20:01:11,411 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-28 20:01:11,413 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 15 msec 2023-09-28 20:01:11,414 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-28 20:01:11,415 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-28 20:01:11,415 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-28 20:01:11,417 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695931871417 2023-09-28 20:01:11,453 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,453 INFO [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-09-28 20:01:11,453 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 20:01:11,454 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-09-28 20:01:11,454 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-28 20:01:11,455 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,455 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,460 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:01:11,460 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:01:11,460 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:01:11,460 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:11,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:01:11,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:01:11,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:01:11,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:01:11,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:01:11,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:01:11,461 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:11,461 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:11,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,461 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,461 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,461 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:11,461 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,462 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-28 20:01:11,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-28 20:01:11,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-28 20:01:11,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-28 20:01:11,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,464 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-28 20:01:11,464 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-28 20:01:11,464 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-28 20:01:11,467 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,467 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,467 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,467 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-28 20:01:11,467 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-28 20:01:11,467 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 20:01:11,467 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 20:01:11,467 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-28 20:01:11,469 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-28 20:01:11,468 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-28 20:01:11,469 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-28 20:01:11,469 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-28 20:01:11,469 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46795,1695931262192' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-28 20:01:11,469 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 20:01:11,469 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33091,1695931262281' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-28 20:01:11,471 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-28 20:01:11,471 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-28 20:01:11,471 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38759,1695931262240' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-28 20:01:11,478 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:11,478 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,478 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:11,478 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:11,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:01:11,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:01:11,479 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,479 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,479 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:01:11,479 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 20:01:11,479 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 20:01:11,479 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,479 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 20:01:11,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:01:11,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:11,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:11,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:11,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:01:11,481 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38759,1695931262240' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-28 20:01:11,481 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b48e83b[Count = 1] remaining members to acquire global barrier 2023-09-28 20:01:11,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:11,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:01:11,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:01:11,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:01:11,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:01:11,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:11,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:11,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:11,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:01:11,484 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46795,1695931262192' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-28 20:01:11,485 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b48e83b[Count = 0] remaining members to acquire global barrier 2023-09-28 20:01:11,485 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-28 20:01:11,485 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,488 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,488 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,488 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,489 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-28 20:01:11,489 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-28 20:01:11,489 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:11,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,489 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-28 20:01:11,489 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-28 20:01:11,489 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,33091,1695931262281' in zk 2023-09-28 20:01:11,489 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:11,489 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-28 20:01:11,490 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 20:01:11,490 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 20:01:11,490 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 20:01:11,490 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695931270086.b2c86ecab66cb236a12767a0bf81f815. 2023-09-28 20:01:11,490 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 20:01:11,490 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695931270086.0a41e8360b39e45516212d158359f349. 2023-09-28 20:01:11,492 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-28 20:01:11,492 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695931270086.b2c86ecab66cb236a12767a0bf81f815. started... 2023-09-28 20:01:11,492 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 20:01:11,492 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695931270086.0a41e8360b39e45516212d158359f349. started... 2023-09-28 20:01:11,492 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-28 20:01:11,497 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b2c86ecab66cb236a12767a0bf81f815: 2023-09-28 20:01:11,497 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0a41e8360b39e45516212d158359f349: 2023-09-28 20:01:11,498 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695931270086.b2c86ecab66cb236a12767a0bf81f815.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,498 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695931270086.0a41e8360b39e45516212d158359f349.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,504 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 20:01:11,504 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 20:01:11,508 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-28 20:01:11,508 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-28 20:01:11,515 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 20:01:11,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-28 20:01:11,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-28 20:01:11,520 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-28 20:01:11,548 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695931270086.b2c86ecab66cb236a12767a0bf81f815. completed. 2023-09-28 20:01:11,548 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695931270086.0a41e8360b39e45516212d158359f349. completed. 2023-09-28 20:01:11,549 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695931270086.b2c86ecab66cb236a12767a0bf81f815. 2023-09-28 20:01:11,549 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695931270086.0a41e8360b39e45516212d158359f349. 2023-09-28 20:01:11,549 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 20:01:11,549 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 20:01:11,549 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 20:01:11,549 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 20:01:11,549 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:11,549 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:11,550 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-28 20:01:11,550 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-28 20:01:11,550 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,46795,1695931262192' in zk 2023-09-28 20:01:11,550 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,38759,1695931262240' in zk 2023-09-28 20:01:11,553 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-28 20:01:11,553 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:11,553 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 20:01:11,553 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-28 20:01:11,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:11,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:01:11,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:01:11,555 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:11,555 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-28 20:01:11,555 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 20:01:11,555 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-28 20:01:11,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:01:11,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:01:11,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:11,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:11,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:11,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:01:11,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:11,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:11,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:11,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,38759,1695931262240': 2023-09-28 20:01:11,561 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38759,1695931262240' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-28 20:01:11,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:11,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:01:11,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:01:11,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:01:11,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:01:11,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:11,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:11,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:11,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:01:11,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:11,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:11,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:11,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,46795,1695931262192': 2023-09-28 20:01:11,566 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46795,1695931262192' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-28 20:01:11,566 INFO [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-09-28 20:01:11,566 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-28 20:01:11,566 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-28 20:01:11,567 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,567 INFO [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-28 20:01:11,570 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,570 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,570 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:01:11,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,570 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:01:11,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:01:11,570 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:01:11,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,570 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:01:11,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:01:11,571 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:01:11,571 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:11,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:01:11,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:01:11,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:01:11,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,571 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:11,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:01:11,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:01:11,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,572 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:11,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:01:11,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:11,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:11,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:11,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:01:11,574 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:11,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,574 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:11,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:11,575 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:11,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:11,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:11,588 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:01:11,588 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:11,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:01:11,588 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:01:11,589 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:01:11,588 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:01:11,589 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-28 20:01:11,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:01:11,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:01:11,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:01:11,589 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:01:11,588 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 20:01:11,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:01:11,588 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:01:11,588 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,589 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,589 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:01:11,590 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-28 20:01:11,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:01:11,590 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:11,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:01:11,590 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:11,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:01:11,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:01:11,591 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,591 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:11,591 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,591 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:11,591 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:11,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:01:11,591 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:01:11,591 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,592 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-28 20:01:11,611 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,614 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,667 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,668 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-28 20:01:11,668 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,669 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:11,669 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695931271406Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695931271611 (+205 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1695931271611Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1695931271611Writing data manifest for emptySnaptb0-testExportWithTargetName at 1695931271624 (+13 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1695931271655 (+31 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695931271668 (+13 ms) 2023-09-28 20:01:11,671 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-28 20:01:11,674 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 263 msec 2023-09-28 20:01:11,720 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 20:01:11,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-28 20:01:11,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-28 20:01:11,741 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38759] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1695931270086.b2c86ecab66cb236a12767a0bf81f815. with WAL disabled. Data may be lost in the event of a crash. 2023-09-28 20:01:11,744 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46795] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1695931270086.0a41e8360b39e45516212d158359f349. with WAL disabled. Data may be lost in the event of a crash. 2023-09-28 20:01:11,750 DEBUG [Listener at jenkins-hbase4.apache.org/41509] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-28 20:01:11,751 DEBUG [Listener at jenkins-hbase4.apache.org/41509] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695931270086.b2c86ecab66cb236a12767a0bf81f815. 2023-09-28 20:01:11,751 INFO [Listener at jenkins-hbase4.apache.org/41509] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-28 20:01:11,768 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-28 20:01:11,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695931271768 (current time:1695931271768). 2023-09-28 20:01:11,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-28 20:01:11,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] zookeeper.ReadOnlyZKClient(139): Connect 0x76550fbd to 127.0.0.1:50329 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 20:01:11,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@352bdfe0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 20:01:11,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 20:01:11,782 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32806, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 20:01:11,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x76550fbd to 127.0.0.1:50329 2023-09-28 20:01:11,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 20:01:11,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] zookeeper.ReadOnlyZKClient(139): Connect 0x75d8bf70 to 127.0.0.1:50329 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 20:01:11,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2bae6e91, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 20:01:11,793 DEBUG [hconnection-0x409170db-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 20:01:11,796 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32812, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 20:01:11,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x75d8bf70 to 127.0.0.1:50329 2023-09-28 20:01:11,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 20:01:11,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-28 20:01:11,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-28 20:01:11,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-28 20:01:11,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-28 20:01:11,808 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-28 20:01:11,809 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695931871809 2023-09-28 20:01:11,809 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-28 20:01:11,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-28 20:01:11,810 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-28 20:01:11,810 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-28 20:01:11,811 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-28 20:01:11,812 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-28 20:01:11,814 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 7 msec 2023-09-28 20:01:11,815 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-28 20:01:11,816 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695931871816 2023-09-28 20:01:11,832 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-09-28 20:01:11,832 INFO [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-09-28 20:01:11,833 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 20:01:11,834 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-09-28 20:01:11,834 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-28 20:01:11,834 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 20:01:11,834 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-28 20:01:11,836 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:01:11,836 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:01:11,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:01:11,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:01:11,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:01:11,836 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:11,836 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:01:11,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:01:11,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:01:11,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:01:11,837 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:11,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-28 20:01:11,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-28 20:01:11,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-28 20:01:11,837 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:11,838 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 20:01:11,838 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 20:01:11,838 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 20:01:11,838 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:11,838 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-28 20:01:11,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-28 20:01:11,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-28 20:01:11,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-28 20:01:11,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-28 20:01:11,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-28 20:01:11,838 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-28 20:01:11,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-28 20:01:11,838 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-28 20:01:11,839 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-28 20:01:11,839 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-28 20:01:11,839 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-28 20:01:11,839 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-28 20:01:11,839 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-28 20:01:11,839 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 20:01:11,839 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-28 20:01:11,839 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-28 20:01:11,840 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 20:01:11,840 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-28 20:01:11,841 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-28 20:01:11,841 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-28 20:01:11,840 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 20:01:11,841 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46795,1695931262192' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-28 20:01:11,842 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-28 20:01:11,841 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-28 20:01:11,842 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-28 20:01:11,842 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38759,1695931262240' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-28 20:01:11,842 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33091,1695931262281' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-28 20:01:11,844 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:11,844 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 20:01:11,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:11,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:01:11,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:01:11,845 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:11,845 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 20:01:11,845 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 20:01:11,845 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 20:01:11,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:01:11,845 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 20:01:11,846 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 20:01:11,846 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 20:01:11,846 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 20:01:11,846 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 20:01:11,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:01:11,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-28 20:01:11,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:11,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:11,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:11,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:01:11,848 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46795,1695931262192' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-28 20:01:11,848 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@31191f32[Count = 1] remaining members to acquire global barrier 2023-09-28 20:01:11,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:11,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:01:11,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:01:11,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:01:11,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:01:11,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-28 20:01:11,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:11,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:11,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:11,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:01:11,850 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38759,1695931262240' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-28 20:01:11,850 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@31191f32[Count = 0] remaining members to acquire global barrier 2023-09-28 20:01:11,850 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-28 20:01:11,850 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 20:01:11,855 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 20:01:11,855 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 20:01:11,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 20:01:11,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 20:01:11,855 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 20:01:11,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 20:01:11,855 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:11,855 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-28 20:01:11,855 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-28 20:01:11,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 20:01:11,855 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,33091,1695931262281' in zk 2023-09-28 20:01:11,856 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-28 20:01:11,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 20:01:11,856 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:11,856 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-28 20:01:11,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 20:01:11,856 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 20:01:11,856 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695931270086.0a41e8360b39e45516212d158359f349. 2023-09-28 20:01:11,856 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 20:01:11,856 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695931270086.0a41e8360b39e45516212d158359f349. started... 2023-09-28 20:01:11,856 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-28 20:01:11,856 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 20:01:11,856 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 20:01:11,856 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695931270086.b2c86ecab66cb236a12767a0bf81f815. 2023-09-28 20:01:11,856 INFO [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0a41e8360b39e45516212d158359f349 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-09-28 20:01:11,856 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695931270086.b2c86ecab66cb236a12767a0bf81f815. started... 2023-09-28 20:01:11,857 INFO [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b2c86ecab66cb236a12767a0bf81f815 1/1 column families, dataSize=132 B heapSize=544 B 2023-09-28 20:01:11,858 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-28 20:01:11,858 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 20:01:11,858 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-28 20:01:11,911 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 20:01:11,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-28 20:01:11,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-28 20:01:11,913 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-28 20:01:12,006 INFO [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230928e4fdace3e96b47d3a2dcd0c805408761 to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230928e4fdace3e96b47d3a2dcd0c805408761 2023-09-28 20:01:12,006 INFO [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230928bef9344ee348451e8e055cb44513371b to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230928bef9344ee348451e8e055cb44513371b 2023-09-28 20:01:12,039 INFO [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportWithTargetName/0a41e8360b39e45516212d158359f349/.tmp/cf/56077d186c4f49978554a1b82d9e07c1 2023-09-28 20:01:12,039 INFO [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportWithTargetName/b2c86ecab66cb236a12767a0bf81f815/.tmp/cf/cc9d4c828a1542eebdc0c7614fee8b43 2023-09-28 20:01:12,052 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportWithTargetName/0a41e8360b39e45516212d158359f349/.tmp/cf/56077d186c4f49978554a1b82d9e07c1 as hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportWithTargetName/0a41e8360b39e45516212d158359f349/cf/56077d186c4f49978554a1b82d9e07c1 2023-09-28 20:01:12,052 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportWithTargetName/b2c86ecab66cb236a12767a0bf81f815/.tmp/cf/cc9d4c828a1542eebdc0c7614fee8b43 as hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportWithTargetName/b2c86ecab66cb236a12767a0bf81f815/cf/cc9d4c828a1542eebdc0c7614fee8b43 2023-09-28 20:01:12,061 INFO [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportWithTargetName/b2c86ecab66cb236a12767a0bf81f815/cf/cc9d4c828a1542eebdc0c7614fee8b43, entries=2, sequenceid=6, filesize=5.2 K 2023-09-28 20:01:12,061 INFO [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportWithTargetName/0a41e8360b39e45516212d158359f349/cf/56077d186c4f49978554a1b82d9e07c1, entries=48, sequenceid=6, filesize=13.0 K 2023-09-28 20:01:12,066 INFO [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for b2c86ecab66cb236a12767a0bf81f815 in 209ms, sequenceid=6, compaction requested=false 2023-09-28 20:01:12,066 INFO [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 0a41e8360b39e45516212d158359f349 in 210ms, sequenceid=6, compaction requested=false 2023-09-28 20:01:12,066 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-28 20:01:12,066 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-28 20:01:12,069 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b2c86ecab66cb236a12767a0bf81f815: 2023-09-28 20:01:12,069 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0a41e8360b39e45516212d158359f349: 2023-09-28 20:01:12,069 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695931270086.b2c86ecab66cb236a12767a0bf81f815.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-28 20:01:12,069 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 20:01:12,070 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695931270086.0a41e8360b39e45516212d158359f349.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-28 20:01:12,070 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportWithTargetName/b2c86ecab66cb236a12767a0bf81f815/cf/cc9d4c828a1542eebdc0c7614fee8b43] hfiles 2023-09-28 20:01:12,070 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 20:01:12,070 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportWithTargetName/b2c86ecab66cb236a12767a0bf81f815/cf/cc9d4c828a1542eebdc0c7614fee8b43 for snapshot=snaptb0-testExportWithTargetName 2023-09-28 20:01:12,070 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportWithTargetName/0a41e8360b39e45516212d158359f349/cf/56077d186c4f49978554a1b82d9e07c1] hfiles 2023-09-28 20:01:12,070 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportWithTargetName/0a41e8360b39e45516212d158359f349/cf/56077d186c4f49978554a1b82d9e07c1 for snapshot=snaptb0-testExportWithTargetName 2023-09-28 20:01:12,099 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695931270086.b2c86ecab66cb236a12767a0bf81f815. completed. 2023-09-28 20:01:12,099 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695931270086.b2c86ecab66cb236a12767a0bf81f815. 2023-09-28 20:01:12,099 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 20:01:12,099 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 20:01:12,099 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:12,099 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-28 20:01:12,099 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,38759,1695931262240' in zk 2023-09-28 20:01:12,101 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:12,101 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-28 20:01:12,101 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 20:01:12,102 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-28 20:01:12,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:12,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:01:12,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:01:12,103 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695931270086.0a41e8360b39e45516212d158359f349. completed. 2023-09-28 20:01:12,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:01:12,103 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695931270086.0a41e8360b39e45516212d158359f349. 2023-09-28 20:01:12,103 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 20:01:12,104 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 20:01:12,104 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:12,104 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-28 20:01:12,104 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,46795,1695931262192' in zk 2023-09-28 20:01:12,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:01:12,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-28 20:01:12,105 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:12,105 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-28 20:01:12,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:12,105 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 20:01:12,106 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-28 20:01:12,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:12,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:12,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:01:12,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-28 20:01:12,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:12,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:12,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:12,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,38759,1695931262240': 2023-09-28 20:01:12,109 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38759,1695931262240' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-28 20:01:12,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:12,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:01:12,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:01:12,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:01:12,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:01:12,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-28 20:01:12,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:12,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:12,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:12,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:01:12,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-28 20:01:12,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:12,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:12,113 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 20:01:12,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:12,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,46795,1695931262192': 2023-09-28 20:01:12,114 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46795,1695931262192' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-28 20:01:12,114 INFO [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-09-28 20:01:12,114 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-28 20:01:12,114 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-28 20:01:12,114 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-09-28 20:01:12,114 INFO [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-28 20:01:12,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-28 20:01:12,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-28 20:01:12,115 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-28 20:01:12,117 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 20:01:12,117 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 20:01:12,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 20:01:12,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 20:01:12,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:01:12,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:01:12,118 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 20:01:12,117 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:01:12,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 20:01:12,118 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:01:12,118 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 20:01:12,118 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:01:12,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 20:01:12,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 20:01:12,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 20:01:12,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:01:12,119 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:12,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 20:01:12,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:01:12,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:01:12,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:01:12,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:01:12,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-28 20:01:12,119 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:12,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 20:01:12,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:01:12,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:01:12,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 20:01:12,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:01:12,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 20:01:12,123 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:12,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-28 20:01:12,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:12,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:12,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:12,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:01:12,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-28 20:01:12,126 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:12,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:12,126 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:12,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:12,127 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:12,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:12,139 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:12,139 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:01:12,139 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:01:12,140 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:01:12,140 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:01:12,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:01:12,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:01:12,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:01:12,140 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:01:12,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:01:12,140 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 20:01:12,139 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-28 20:01:12,140 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-09-28 20:01:12,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:01:12,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:01:12,140 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:01:12,141 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-28 20:01:12,141 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:12,141 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:12,141 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-28 20:01:12,141 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-28 20:01:12,141 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-28 20:01:12,141 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:12,141 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 20:01:12,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:01:12,142 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:12,142 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:12,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:01:12,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:01:12,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:01:12,142 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 20:01:12,142 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 20:01:12,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:01:12,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:01:12,143 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230928bef9344ee348451e8e055cb44513371b, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230928e4fdace3e96b47d3a2dcd0c805408761] mob files 2023-09-28 20:01:12,143 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230928bef9344ee348451e8e055cb44513371b 2023-09-28 20:01:12,143 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230928e4fdace3e96b47d3a2dcd0c805408761 2023-09-28 20:01:12,162 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-09-28 20:01:12,163 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-28 20:01:12,201 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-28 20:01:12,202 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-28 20:01:12,202 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-28 20:01:12,203 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-28 20:01:12,203 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695931271809Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695931272162 (+353 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1695931272162Loading Region manifests for snaptb0-testExportWithTargetName at 1695931272162Writing data manifest for snaptb0-testExportWithTargetName at 1695931272168 (+6 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1695931272189 (+21 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695931272202 (+13 ms) 2023-09-28 20:01:12,205 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-28 20:01:12,208 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 396 msec 2023-09-28 20:01:12,415 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 20:01:12,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-28 20:01:12,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-28 20:01:12,419 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/export-test/export-1695931272419 2023-09-28 20:01:12,420 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43143, tgtDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/export-test/export-1695931272419, rawTgtDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/export-test/export-1695931272419, srcFsUri=hdfs://localhost:43143, srcDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff 2023-09-28 20:01:12,472 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43143, inputRoot=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff 2023-09-28 20:01:12,472 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_868076848_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/export-test/export-1695931272419, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/export-test/export-1695931272419/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-28 20:01:12,472 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43143, inputRoot=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff, snapshotDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-09-28 20:01:12,494 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/export-test/export-1695931272419/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-28 20:01:12,574 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-28 20:01:12,575 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-28 20:01:12,576 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-28 20:01:12,576 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-28 20:01:13,498 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/hadoop-2651492785569965239.jar 2023-09-28 20:01:13,499 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-28 20:01:13,500 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-28 20:01:13,567 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/hadoop-8151104381427058457.jar 2023-09-28 20:01:13,568 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-28 20:01:13,569 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-28 20:01:13,569 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-28 20:01:13,569 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-28 20:01:13,570 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-28 20:01:13,570 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-28 20:01:13,571 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-28 20:01:13,571 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-28 20:01:13,572 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-28 20:01:13,572 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-28 20:01:13,573 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-28 20:01:13,573 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-28 20:01:13,574 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-28 20:01:13,574 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-28 20:01:13,574 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-28 20:01:13,575 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-28 20:01:13,579 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 20:01:13,580 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 20:01:13,580 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 20:01:13,580 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 20:01:13,581 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 20:01:13,581 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 20:01:13,582 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 20:01:15,244 WARN [Listener at jenkins-hbase4.apache.org/41509] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-28 20:01:15,249 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-09-28 20:01:15,258 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-28 20:01:15,735 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 20:01:15,737 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 20:01:16,091 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-28 20:01:16,157 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695931268848_0001_000001 (auth:SIMPLE) 2023-09-28 20:01:20,610 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695931268848_0001_000001 (auth:SIMPLE) 2023-09-28 20:01:22,896 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695931268848_0001_000001 (auth:SIMPLE) 2023-09-28 20:01:26,285 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695931268848_0001_000001 (auth:SIMPLE) 2023-09-28 20:01:28,145 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-28 20:01:28,150 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-28 20:01:28,161 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-09-28 20:01:28,161 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-28 20:01:28,162 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-28 20:01:28,162 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_394157282_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-28 20:01:28,163 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(367): hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-09-28 20:01:28,163 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(367): hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-09-28 20:01:28,163 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_394157282_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/export-test/export-1695931272419/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/export-test/export-1695931272419/.hbase-snapshot/testExportWithTargetName 2023-09-28 20:01:28,164 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(367): hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/export-test/export-1695931272419/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-09-28 20:01:28,164 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(367): hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/export-test/export-1695931272419/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-09-28 20:01:28,176 INFO [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-09-28 20:01:28,181 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-09-28 20:01:28,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-09-28 20:01:28,197 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695931288197"}]},"ts":"1695931288197"} 2023-09-28 20:01:28,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-28 20:01:28,200 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-09-28 20:01:28,202 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-09-28 20:01:28,204 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b2c86ecab66cb236a12767a0bf81f815, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0a41e8360b39e45516212d158359f349, UNASSIGN}] 2023-09-28 20:01:28,207 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b2c86ecab66cb236a12767a0bf81f815, UNASSIGN 2023-09-28 20:01:28,207 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0a41e8360b39e45516212d158359f349, UNASSIGN 2023-09-28 20:01:28,208 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=b2c86ecab66cb236a12767a0bf81f815, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:28,209 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=0a41e8360b39e45516212d158359f349, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:28,209 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695931270086.b2c86ecab66cb236a12767a0bf81f815.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695931288208"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695931288208"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695931288208"}]},"ts":"1695931288208"} 2023-09-28 20:01:28,209 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695931270086.0a41e8360b39e45516212d158359f349.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695931288209"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695931288209"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695931288209"}]},"ts":"1695931288209"} 2023-09-28 20:01:28,211 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure b2c86ecab66cb236a12767a0bf81f815, server=jenkins-hbase4.apache.org,38759,1695931262240}] 2023-09-28 20:01:28,212 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 0a41e8360b39e45516212d158359f349, server=jenkins-hbase4.apache.org,46795,1695931262192}] 2023-09-28 20:01:28,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-28 20:01:28,374 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0a41e8360b39e45516212d158359f349 2023-09-28 20:01:28,374 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b2c86ecab66cb236a12767a0bf81f815 2023-09-28 20:01:28,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0a41e8360b39e45516212d158359f349, disabling compactions & flushes 2023-09-28 20:01:28,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b2c86ecab66cb236a12767a0bf81f815, disabling compactions & flushes 2023-09-28 20:01:28,375 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695931270086.0a41e8360b39e45516212d158359f349. 2023-09-28 20:01:28,375 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695931270086.b2c86ecab66cb236a12767a0bf81f815. 2023-09-28 20:01:28,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695931270086.0a41e8360b39e45516212d158359f349. 2023-09-28 20:01:28,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695931270086.b2c86ecab66cb236a12767a0bf81f815. 2023-09-28 20:01:28,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695931270086.0a41e8360b39e45516212d158359f349. after waiting 0 ms 2023-09-28 20:01:28,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695931270086.b2c86ecab66cb236a12767a0bf81f815. after waiting 0 ms 2023-09-28 20:01:28,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695931270086.0a41e8360b39e45516212d158359f349. 2023-09-28 20:01:28,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695931270086.b2c86ecab66cb236a12767a0bf81f815. 2023-09-28 20:01:28,393 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportWithTargetName/0a41e8360b39e45516212d158359f349/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-28 20:01:28,393 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportWithTargetName/b2c86ecab66cb236a12767a0bf81f815/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-28 20:01:28,394 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 20:01:28,394 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 20:01:28,396 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695931270086.b2c86ecab66cb236a12767a0bf81f815. 2023-09-28 20:01:28,396 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695931270086.0a41e8360b39e45516212d158359f349. 2023-09-28 20:01:28,396 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b2c86ecab66cb236a12767a0bf81f815: 2023-09-28 20:01:28,396 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0a41e8360b39e45516212d158359f349: 2023-09-28 20:01:28,398 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b2c86ecab66cb236a12767a0bf81f815 2023-09-28 20:01:28,399 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=b2c86ecab66cb236a12767a0bf81f815, regionState=CLOSED 2023-09-28 20:01:28,400 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695931270086.b2c86ecab66cb236a12767a0bf81f815.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695931288399"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695931288399"}]},"ts":"1695931288399"} 2023-09-28 20:01:28,400 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0a41e8360b39e45516212d158359f349 2023-09-28 20:01:28,400 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=0a41e8360b39e45516212d158359f349, regionState=CLOSED 2023-09-28 20:01:28,401 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695931270086.0a41e8360b39e45516212d158359f349.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695931288400"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695931288400"}]},"ts":"1695931288400"} 2023-09-28 20:01:28,407 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=22 2023-09-28 20:01:28,407 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure b2c86ecab66cb236a12767a0bf81f815, server=jenkins-hbase4.apache.org,38759,1695931262240 in 193 msec 2023-09-28 20:01:28,408 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=23 2023-09-28 20:01:28,408 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 0a41e8360b39e45516212d158359f349, server=jenkins-hbase4.apache.org,46795,1695931262192 in 193 msec 2023-09-28 20:01:28,408 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b2c86ecab66cb236a12767a0bf81f815, UNASSIGN in 203 msec 2023-09-28 20:01:28,410 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=23, resume processing ppid=21 2023-09-28 20:01:28,410 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0a41e8360b39e45516212d158359f349, UNASSIGN in 204 msec 2023-09-28 20:01:28,411 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695931288411"}]},"ts":"1695931288411"} 2023-09-28 20:01:28,413 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-09-28 20:01:28,415 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-09-28 20:01:28,417 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 231 msec 2023-09-28 20:01:28,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-28 20:01:28,501 INFO [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-09-28 20:01:28,506 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-09-28 20:01:28,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-28 20:01:28,516 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-28 20:01:28,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-09-28 20:01:28,519 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-28 20:01:28,522 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33091] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-09-28 20:01:28,525 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportWithTargetName/b2c86ecab66cb236a12767a0bf81f815 2023-09-28 20:01:28,525 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportWithTargetName/0a41e8360b39e45516212d158359f349 2023-09-28 20:01:28,525 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-28 20:01:28,525 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-28 20:01:28,526 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-28 20:01:28,525 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-28 20:01:28,527 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 20:01:28,528 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 20:01:28,528 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-28 20:01:28,528 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-28 20:01:28,528 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-28 20:01:28,528 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-28 20:01:28,528 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-28 20:01:28,528 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 20:01:28,528 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 20:01:28,528 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-28 20:01:28,528 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-28 20:01:28,528 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-28 20:01:28,529 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportWithTargetName/b2c86ecab66cb236a12767a0bf81f815/cf, FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportWithTargetName/b2c86ecab66cb236a12767a0bf81f815/recovered.edits] 2023-09-28 20:01:28,529 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportWithTargetName/0a41e8360b39e45516212d158359f349/cf, FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportWithTargetName/0a41e8360b39e45516212d158359f349/recovered.edits] 2023-09-28 20:01:28,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-28 20:01:28,537 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportWithTargetName/0a41e8360b39e45516212d158359f349/cf/56077d186c4f49978554a1b82d9e07c1 to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/archive/data/default/testtb-testExportWithTargetName/0a41e8360b39e45516212d158359f349/cf/56077d186c4f49978554a1b82d9e07c1 2023-09-28 20:01:28,537 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportWithTargetName/b2c86ecab66cb236a12767a0bf81f815/cf/cc9d4c828a1542eebdc0c7614fee8b43 to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/archive/data/default/testtb-testExportWithTargetName/b2c86ecab66cb236a12767a0bf81f815/cf/cc9d4c828a1542eebdc0c7614fee8b43 2023-09-28 20:01:28,542 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportWithTargetName/b2c86ecab66cb236a12767a0bf81f815/recovered.edits/9.seqid to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/archive/data/default/testtb-testExportWithTargetName/b2c86ecab66cb236a12767a0bf81f815/recovered.edits/9.seqid 2023-09-28 20:01:28,542 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportWithTargetName/0a41e8360b39e45516212d158359f349/recovered.edits/9.seqid to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/archive/data/default/testtb-testExportWithTargetName/0a41e8360b39e45516212d158359f349/recovered.edits/9.seqid 2023-09-28 20:01:28,543 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportWithTargetName/b2c86ecab66cb236a12767a0bf81f815 2023-09-28 20:01:28,543 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportWithTargetName/0a41e8360b39e45516212d158359f349 2023-09-28 20:01:28,543 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-28 20:01:28,544 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-28 20:01:28,545 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-09-28 20:01:28,550 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230928bef9344ee348451e8e055cb44513371b to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230928bef9344ee348451e8e055cb44513371b 2023-09-28 20:01:28,552 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230928e4fdace3e96b47d3a2dcd0c805408761 to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230928e4fdace3e96b47d3a2dcd0c805408761 2023-09-28 20:01:28,553 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-28 20:01:28,556 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-28 20:01:28,582 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-09-28 20:01:28,586 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-09-28 20:01:28,587 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-28 20:01:28,587 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-09-28 20:01:28,588 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1695931270086.b2c86ecab66cb236a12767a0bf81f815.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695931288587"}]},"ts":"9223372036854775807"} 2023-09-28 20:01:28,588 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1695931270086.0a41e8360b39e45516212d158359f349.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695931288587"}]},"ts":"9223372036854775807"} 2023-09-28 20:01:28,590 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-28 20:01:28,590 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b2c86ecab66cb236a12767a0bf81f815, NAME => 'testtb-testExportWithTargetName,,1695931270086.b2c86ecab66cb236a12767a0bf81f815.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 0a41e8360b39e45516212d158359f349, NAME => 'testtb-testExportWithTargetName,1,1695931270086.0a41e8360b39e45516212d158359f349.', STARTKEY => '1', ENDKEY => ''}] 2023-09-28 20:01:28,590 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-09-28 20:01:28,590 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695931288590"}]},"ts":"9223372036854775807"} 2023-09-28 20:01:28,592 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-09-28 20:01:28,595 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-28 20:01:28,596 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 88 msec 2023-09-28 20:01:28,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-28 20:01:28,637 INFO [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-09-28 20:01:28,659 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-09-28 20:01:28,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-09-28 20:01:28,666 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-09-28 20:01:28,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-09-28 20:01:28,699 INFO [Listener at jenkins-hbase4.apache.org/41509] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=758 (was 707) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1dd01c2f-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/cluster_5fb315ef-67a6-d9cd-3b9f-c66cc0d16763/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/cluster_5fb315ef-67a6-d9cd-3b9f-c66cc0d16763/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_526522588_1 at /127.0.0.1:36830 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/cluster_5fb315ef-67a6-d9cd-3b9f-c66cc0d16763/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:45089 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/cluster_5fb315ef-67a6-d9cd-3b9f-c66cc0d16763/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/cluster_5fb315ef-67a6-d9cd-3b9f-c66cc0d16763/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1dd01c2f-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1283 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_526522588_1 at /127.0.0.1:40922 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/cluster_5fb315ef-67a6-d9cd-3b9f-c66cc0d16763/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:42501 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:37701 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_394157282_17 at /127.0.0.1:40944 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_394157282_17 at /127.0.0.1:36858 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1dd01c2f-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1dd01c2f-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_394157282_17 at /127.0.0.1:50802 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=935 (was 900) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=285 (was 166) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 165) - ProcessCount LEAK? -, AvailableMemoryMB=4818 (was 5646) 2023-09-28 20:01:28,700 WARN [Listener at jenkins-hbase4.apache.org/41509] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-09-28 20:01:28,722 INFO [Listener at jenkins-hbase4.apache.org/41509] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=758, OpenFileDescriptor=935, MaxFileDescriptor=60000, SystemLoadAverage=285, ProcessCount=168, AvailableMemoryMB=4818 2023-09-28 20:01:28,723 WARN [Listener at jenkins-hbase4.apache.org/41509] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-09-28 20:01:28,725 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-28 20:01:28,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-09-28 20:01:28,731 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-28 20:01:28,733 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-09-28 20:01:28,734 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-28 20:01:28,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-28 20:01:28,737 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemState/eeac3214eb65fd0b6475ef99f06e595a 2023-09-28 20:01:28,737 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemState/d4340ba4962a89c2bfd1eaad9f37fdd6 2023-09-28 20:01:28,738 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemState/eeac3214eb65fd0b6475ef99f06e595a empty. 2023-09-28 20:01:28,738 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemState/d4340ba4962a89c2bfd1eaad9f37fdd6 empty. 2023-09-28 20:01:28,738 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemState/eeac3214eb65fd0b6475ef99f06e595a 2023-09-28 20:01:28,738 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemState/d4340ba4962a89c2bfd1eaad9f37fdd6 2023-09-28 20:01:28,738 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-28 20:01:28,754 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-28 20:01:28,756 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => eeac3214eb65fd0b6475ef99f06e595a, NAME => 'testtb-testExportFileSystemState,,1695931288725.eeac3214eb65fd0b6475ef99f06e595a.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp 2023-09-28 20:01:28,756 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => d4340ba4962a89c2bfd1eaad9f37fdd6, NAME => 'testtb-testExportFileSystemState,1,1695931288725.d4340ba4962a89c2bfd1eaad9f37fdd6.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp 2023-09-28 20:01:28,782 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695931288725.d4340ba4962a89c2bfd1eaad9f37fdd6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 20:01:28,782 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing d4340ba4962a89c2bfd1eaad9f37fdd6, disabling compactions & flushes 2023-09-28 20:01:28,782 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695931288725.d4340ba4962a89c2bfd1eaad9f37fdd6. 2023-09-28 20:01:28,782 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695931288725.d4340ba4962a89c2bfd1eaad9f37fdd6. 2023-09-28 20:01:28,782 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695931288725.d4340ba4962a89c2bfd1eaad9f37fdd6. after waiting 0 ms 2023-09-28 20:01:28,782 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695931288725.d4340ba4962a89c2bfd1eaad9f37fdd6. 2023-09-28 20:01:28,782 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695931288725.d4340ba4962a89c2bfd1eaad9f37fdd6. 2023-09-28 20:01:28,782 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for d4340ba4962a89c2bfd1eaad9f37fdd6: 2023-09-28 20:01:28,785 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695931288725.eeac3214eb65fd0b6475ef99f06e595a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 20:01:28,786 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing eeac3214eb65fd0b6475ef99f06e595a, disabling compactions & flushes 2023-09-28 20:01:28,786 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695931288725.eeac3214eb65fd0b6475ef99f06e595a. 2023-09-28 20:01:28,786 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695931288725.eeac3214eb65fd0b6475ef99f06e595a. 2023-09-28 20:01:28,786 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695931288725.eeac3214eb65fd0b6475ef99f06e595a. after waiting 0 ms 2023-09-28 20:01:28,786 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695931288725.eeac3214eb65fd0b6475ef99f06e595a. 2023-09-28 20:01:28,786 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695931288725.eeac3214eb65fd0b6475ef99f06e595a. 2023-09-28 20:01:28,786 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for eeac3214eb65fd0b6475ef99f06e595a: 2023-09-28 20:01:28,790 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-28 20:01:28,791 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695931288725.d4340ba4962a89c2bfd1eaad9f37fdd6.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695931288790"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695931288790"}]},"ts":"1695931288790"} 2023-09-28 20:01:28,791 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695931288725.eeac3214eb65fd0b6475ef99f06e595a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695931288790"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695931288790"}]},"ts":"1695931288790"} 2023-09-28 20:01:28,794 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-28 20:01:28,795 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-28 20:01:28,795 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695931288795"}]},"ts":"1695931288795"} 2023-09-28 20:01:28,797 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-09-28 20:01:28,802 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-28 20:01:28,803 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-28 20:01:28,803 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-28 20:01:28,803 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-28 20:01:28,803 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-28 20:01:28,804 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=eeac3214eb65fd0b6475ef99f06e595a, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d4340ba4962a89c2bfd1eaad9f37fdd6, ASSIGN}] 2023-09-28 20:01:28,807 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d4340ba4962a89c2bfd1eaad9f37fdd6, ASSIGN 2023-09-28 20:01:28,807 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=eeac3214eb65fd0b6475ef99f06e595a, ASSIGN 2023-09-28 20:01:28,808 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d4340ba4962a89c2bfd1eaad9f37fdd6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33091,1695931262281; forceNewPlan=false, retain=false 2023-09-28 20:01:28,808 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=eeac3214eb65fd0b6475ef99f06e595a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38759,1695931262240; forceNewPlan=false, retain=false 2023-09-28 20:01:28,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-28 20:01:28,958 INFO [jenkins-hbase4:35173] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-28 20:01:28,961 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=eeac3214eb65fd0b6475ef99f06e595a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:28,961 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=d4340ba4962a89c2bfd1eaad9f37fdd6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:28,961 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695931288725.eeac3214eb65fd0b6475ef99f06e595a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695931288961"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695931288961"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695931288961"}]},"ts":"1695931288961"} 2023-09-28 20:01:28,961 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695931288725.d4340ba4962a89c2bfd1eaad9f37fdd6.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695931288961"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695931288961"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695931288961"}]},"ts":"1695931288961"} 2023-09-28 20:01:28,963 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure eeac3214eb65fd0b6475ef99f06e595a, server=jenkins-hbase4.apache.org,38759,1695931262240}] 2023-09-28 20:01:28,965 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure d4340ba4962a89c2bfd1eaad9f37fdd6, server=jenkins-hbase4.apache.org,33091,1695931262281}] 2023-09-28 20:01:29,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-28 20:01:29,124 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1695931288725.eeac3214eb65fd0b6475ef99f06e595a. 2023-09-28 20:01:29,124 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1695931288725.d4340ba4962a89c2bfd1eaad9f37fdd6. 2023-09-28 20:01:29,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => eeac3214eb65fd0b6475ef99f06e595a, NAME => 'testtb-testExportFileSystemState,,1695931288725.eeac3214eb65fd0b6475ef99f06e595a.', STARTKEY => '', ENDKEY => '1'} 2023-09-28 20:01:29,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d4340ba4962a89c2bfd1eaad9f37fdd6, NAME => 'testtb-testExportFileSystemState,1,1695931288725.d4340ba4962a89c2bfd1eaad9f37fdd6.', STARTKEY => '1', ENDKEY => ''} 2023-09-28 20:01:29,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1695931288725.eeac3214eb65fd0b6475ef99f06e595a. service=AccessControlService 2023-09-28 20:01:29,125 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 20:01:29,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState eeac3214eb65fd0b6475ef99f06e595a 2023-09-28 20:01:29,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695931288725.eeac3214eb65fd0b6475ef99f06e595a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 20:01:29,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for eeac3214eb65fd0b6475ef99f06e595a 2023-09-28 20:01:29,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1695931288725.d4340ba4962a89c2bfd1eaad9f37fdd6. service=AccessControlService 2023-09-28 20:01:29,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for eeac3214eb65fd0b6475ef99f06e595a 2023-09-28 20:01:29,125 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 20:01:29,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState d4340ba4962a89c2bfd1eaad9f37fdd6 2023-09-28 20:01:29,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695931288725.d4340ba4962a89c2bfd1eaad9f37fdd6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 20:01:29,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d4340ba4962a89c2bfd1eaad9f37fdd6 2023-09-28 20:01:29,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d4340ba4962a89c2bfd1eaad9f37fdd6 2023-09-28 20:01:29,129 INFO [StoreOpener-eeac3214eb65fd0b6475ef99f06e595a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region eeac3214eb65fd0b6475ef99f06e595a 2023-09-28 20:01:29,129 INFO [StoreOpener-d4340ba4962a89c2bfd1eaad9f37fdd6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d4340ba4962a89c2bfd1eaad9f37fdd6 2023-09-28 20:01:29,131 DEBUG [StoreOpener-eeac3214eb65fd0b6475ef99f06e595a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemState/eeac3214eb65fd0b6475ef99f06e595a/cf 2023-09-28 20:01:29,131 DEBUG [StoreOpener-eeac3214eb65fd0b6475ef99f06e595a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemState/eeac3214eb65fd0b6475ef99f06e595a/cf 2023-09-28 20:01:29,131 DEBUG [StoreOpener-d4340ba4962a89c2bfd1eaad9f37fdd6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemState/d4340ba4962a89c2bfd1eaad9f37fdd6/cf 2023-09-28 20:01:29,131 DEBUG [StoreOpener-d4340ba4962a89c2bfd1eaad9f37fdd6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemState/d4340ba4962a89c2bfd1eaad9f37fdd6/cf 2023-09-28 20:01:29,131 INFO [StoreOpener-eeac3214eb65fd0b6475ef99f06e595a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eeac3214eb65fd0b6475ef99f06e595a columnFamilyName cf 2023-09-28 20:01:29,132 INFO [StoreOpener-d4340ba4962a89c2bfd1eaad9f37fdd6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d4340ba4962a89c2bfd1eaad9f37fdd6 columnFamilyName cf 2023-09-28 20:01:29,133 INFO [StoreOpener-eeac3214eb65fd0b6475ef99f06e595a-1] regionserver.HStore(310): Store=eeac3214eb65fd0b6475ef99f06e595a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 20:01:29,135 INFO [StoreOpener-d4340ba4962a89c2bfd1eaad9f37fdd6-1] regionserver.HStore(310): Store=d4340ba4962a89c2bfd1eaad9f37fdd6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 20:01:29,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemState/eeac3214eb65fd0b6475ef99f06e595a 2023-09-28 20:01:29,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemState/d4340ba4962a89c2bfd1eaad9f37fdd6 2023-09-28 20:01:29,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemState/eeac3214eb65fd0b6475ef99f06e595a 2023-09-28 20:01:29,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemState/d4340ba4962a89c2bfd1eaad9f37fdd6 2023-09-28 20:01:29,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for eeac3214eb65fd0b6475ef99f06e595a 2023-09-28 20:01:29,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d4340ba4962a89c2bfd1eaad9f37fdd6 2023-09-28 20:01:29,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemState/eeac3214eb65fd0b6475ef99f06e595a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 20:01:29,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemState/d4340ba4962a89c2bfd1eaad9f37fdd6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 20:01:29,145 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened eeac3214eb65fd0b6475ef99f06e595a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69450897, jitterRate=0.03489901125431061}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 20:01:29,145 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d4340ba4962a89c2bfd1eaad9f37fdd6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67051484, jitterRate=-8.550286293029785E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 20:01:29,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for eeac3214eb65fd0b6475ef99f06e595a: 2023-09-28 20:01:29,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d4340ba4962a89c2bfd1eaad9f37fdd6: 2023-09-28 20:01:29,146 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1695931288725.d4340ba4962a89c2bfd1eaad9f37fdd6., pid=31, masterSystemTime=1695931289116 2023-09-28 20:01:29,146 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1695931288725.eeac3214eb65fd0b6475ef99f06e595a., pid=30, masterSystemTime=1695931289116 2023-09-28 20:01:29,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1695931288725.eeac3214eb65fd0b6475ef99f06e595a. 2023-09-28 20:01:29,149 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1695931288725.eeac3214eb65fd0b6475ef99f06e595a. 2023-09-28 20:01:29,150 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=eeac3214eb65fd0b6475ef99f06e595a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:29,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1695931288725.d4340ba4962a89c2bfd1eaad9f37fdd6. 2023-09-28 20:01:29,150 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1695931288725.d4340ba4962a89c2bfd1eaad9f37fdd6. 2023-09-28 20:01:29,150 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1695931288725.eeac3214eb65fd0b6475ef99f06e595a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695931289150"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695931289150"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695931289150"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695931289150"}]},"ts":"1695931289150"} 2023-09-28 20:01:29,151 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=d4340ba4962a89c2bfd1eaad9f37fdd6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:29,151 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1695931288725.d4340ba4962a89c2bfd1eaad9f37fdd6.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695931289151"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695931289151"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695931289151"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695931289151"}]},"ts":"1695931289151"} 2023-09-28 20:01:29,155 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=28 2023-09-28 20:01:29,157 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure eeac3214eb65fd0b6475ef99f06e595a, server=jenkins-hbase4.apache.org,38759,1695931262240 in 189 msec 2023-09-28 20:01:29,158 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=29 2023-09-28 20:01:29,160 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure d4340ba4962a89c2bfd1eaad9f37fdd6, server=jenkins-hbase4.apache.org,33091,1695931262281 in 189 msec 2023-09-28 20:01:29,161 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=eeac3214eb65fd0b6475ef99f06e595a, ASSIGN in 353 msec 2023-09-28 20:01:29,162 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=29, resume processing ppid=27 2023-09-28 20:01:29,163 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d4340ba4962a89c2bfd1eaad9f37fdd6, ASSIGN in 356 msec 2023-09-28 20:01:29,165 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-28 20:01:29,165 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695931289165"}]},"ts":"1695931289165"} 2023-09-28 20:01:29,167 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-09-28 20:01:29,170 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-28 20:01:29,170 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-09-28 20:01:29,172 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33091] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-28 20:01:29,174 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 20:01:29,174 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 20:01:29,174 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 20:01:29,174 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 20:01:29,176 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-28 20:01:29,176 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-28 20:01:29,176 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-28 20:01:29,177 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-28 20:01:29,178 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 449 msec 2023-09-28 20:01:29,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-28 20:01:29,339 INFO [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-09-28 20:01:29,342 DEBUG [Listener at jenkins-hbase4.apache.org/41509] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-28 20:01:29,342 DEBUG [Listener at jenkins-hbase4.apache.org/41509] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695931288725.eeac3214eb65fd0b6475ef99f06e595a. 2023-09-28 20:01:29,344 INFO [Listener at jenkins-hbase4.apache.org/41509] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-28 20:01:29,366 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-28 20:01:29,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695931289366 (current time:1695931289366). 2023-09-28 20:01:29,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-28 20:01:29,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] zookeeper.ReadOnlyZKClient(139): Connect 0x6ffe9a28 to 127.0.0.1:50329 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 20:01:29,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@20a2e03c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 20:01:29,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 20:01:29,378 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55620, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 20:01:29,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6ffe9a28 to 127.0.0.1:50329 2023-09-28 20:01:29,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 20:01:29,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] zookeeper.ReadOnlyZKClient(139): Connect 0x78ea23bd to 127.0.0.1:50329 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 20:01:29,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@63dec952, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 20:01:29,390 DEBUG [hconnection-0x54ca7615-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 20:01:29,393 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55630, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 20:01:29,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x78ea23bd to 127.0.0.1:50329 2023-09-28 20:01:29,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 20:01:29,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-28 20:01:29,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-28 20:01:29,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-28 20:01:29,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-28 20:01:29,407 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-28 20:01:29,408 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695931889408 2023-09-28 20:01:29,408 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-28 20:01:29,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-28 20:01:29,409 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-28 20:01:29,409 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-28 20:01:29,414 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-28 20:01:29,415 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-28 20:01:29,416 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 11 msec 2023-09-28 20:01:29,418 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-28 20:01:29,419 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695931889419 2023-09-28 20:01:29,451 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,451 INFO [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-09-28 20:01:29,451 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 20:01:29,453 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-09-28 20:01:29,454 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-28 20:01:29,454 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,454 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,457 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:01:29,457 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:01:29,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:01:29,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:01:29,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:01:29,457 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:01:29,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:01:29,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:01:29,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:01:29,457 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:29,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,459 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,459 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,459 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:29,459 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:29,459 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-28 20:01:29,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-28 20:01:29,460 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-28 20:01:29,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,460 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-28 20:01:29,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-28 20:01:29,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,460 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-28 20:01:29,460 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:29,460 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-28 20:01:29,466 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,467 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,467 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-28 20:01:29,467 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-28 20:01:29,467 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 20:01:29,467 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 20:01:29,469 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-28 20:01:29,471 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-28 20:01:29,467 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,471 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33091,1695931262281' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-28 20:01:29,471 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-28 20:01:29,470 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-28 20:01:29,471 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-28 20:01:29,471 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 20:01:29,471 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38759,1695931262240' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-28 20:01:29,472 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-28 20:01:29,473 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-28 20:01:29,473 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46795,1695931262192' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-28 20:01:29,474 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,474 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:29,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:29,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:01:29,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:01:29,481 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:29,481 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,481 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,481 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:01:29,483 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 20:01:29,483 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,483 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 20:01:29,483 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,484 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 20:01:29,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:01:29,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:29,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:29,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:29,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:01:29,486 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33091,1695931262281' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-28 20:01:29,486 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53a4f699[Count = 1] remaining members to acquire global barrier 2023-09-28 20:01:29,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:29,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:01:29,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:01:29,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:01:29,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:01:29,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:29,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:29,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:29,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:01:29,488 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38759,1695931262240' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-28 20:01:29,489 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53a4f699[Count = 0] remaining members to acquire global barrier 2023-09-28 20:01:29,489 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-28 20:01:29,489 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,490 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,490 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,490 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,490 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:29,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,490 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-28 20:01:29,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,491 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-28 20:01:29,491 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-28 20:01:29,491 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:29,491 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 20:01:29,491 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 20:01:29,491 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-28 20:01:29,491 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695931288725.eeac3214eb65fd0b6475ef99f06e595a. 2023-09-28 20:01:29,491 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695931288725.d4340ba4962a89c2bfd1eaad9f37fdd6. 2023-09-28 20:01:29,491 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695931288725.eeac3214eb65fd0b6475ef99f06e595a. started... 2023-09-28 20:01:29,491 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46795,1695931262192' in zk 2023-09-28 20:01:29,491 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 20:01:29,491 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 20:01:29,491 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-28 20:01:29,491 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695931288725.d4340ba4962a89c2bfd1eaad9f37fdd6. started... 2023-09-28 20:01:29,491 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for eeac3214eb65fd0b6475ef99f06e595a: 2023-09-28 20:01:29,493 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d4340ba4962a89c2bfd1eaad9f37fdd6: 2023-09-28 20:01:29,493 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695931288725.eeac3214eb65fd0b6475ef99f06e595a.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,493 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695931288725.d4340ba4962a89c2bfd1eaad9f37fdd6.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,493 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 20:01:29,493 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 20:01:29,494 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-28 20:01:29,494 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-28 20:01:29,494 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-28 20:01:29,494 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 20:01:29,495 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-28 20:01:29,509 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 20:01:29,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-28 20:01:29,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-28 20:01:29,510 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-28 20:01:29,514 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695931288725.eeac3214eb65fd0b6475ef99f06e595a. completed. 2023-09-28 20:01:29,514 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695931288725.eeac3214eb65fd0b6475ef99f06e595a. 2023-09-28 20:01:29,514 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 20:01:29,514 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 20:01:29,514 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:29,514 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-28 20:01:29,515 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38759,1695931262240' in zk 2023-09-28 20:01:29,515 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695931288725.d4340ba4962a89c2bfd1eaad9f37fdd6. completed. 2023-09-28 20:01:29,515 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695931288725.d4340ba4962a89c2bfd1eaad9f37fdd6. 2023-09-28 20:01:29,515 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 20:01:29,515 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 20:01:29,515 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:29,515 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-28 20:01:29,515 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33091,1695931262281' in zk 2023-09-28 20:01:29,516 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:29,517 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-28 20:01:29,517 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 20:01:29,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:29,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:01:29,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:01:29,517 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-28 20:01:29,518 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:29,519 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-28 20:01:29,519 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 20:01:29,519 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-28 20:01:29,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:01:29,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:01:29,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:29,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:29,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:29,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:01:29,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:29,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:29,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:29,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,38759,1695931262240': 2023-09-28 20:01:29,523 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38759,1695931262240' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-28 20:01:29,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:29,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:01:29,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:01:29,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:01:29,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:01:29,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:29,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:29,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:29,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:01:29,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:29,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:29,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:29,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,33091,1695931262281': 2023-09-28 20:01:29,527 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33091,1695931262281' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-28 20:01:29,527 INFO [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-09-28 20:01:29,527 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-28 20:01:29,527 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-28 20:01:29,527 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,527 INFO [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-28 20:01:29,530 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,530 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:01:29,530 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,530 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,530 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:01:29,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,530 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:01:29,530 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,533 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:29,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:01:29,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:01:29,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:01:29,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:01:29,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:01:29,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:01:29,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:01:29,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:01:29,536 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:29,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:01:29,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,536 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:29,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:01:29,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:29,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:29,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:29,541 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:29,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:01:29,542 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:29,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,543 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:29,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:29,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:29,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:29,546 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:29,546 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,546 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:29,546 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:01:29,546 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:01:29,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:01:29,546 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:01:29,546 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:01:29,546 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:01:29,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:01:29,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:01:29,546 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:01:29,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:01:29,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:01:29,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:01:29,546 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:29,546 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,547 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-28 20:01:29,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:01:29,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:01:29,546 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 20:01:29,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:01:29,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:01:29,547 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,547 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,549 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-28 20:01:29,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:01:29,549 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:29,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:01:29,549 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,550 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:29,550 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:29,550 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,550 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,550 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-28 20:01:29,564 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,565 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,589 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,590 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-28 20:01:29,590 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,591 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:29,591 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695931289408Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695931289564 (+156 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1695931289564Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1695931289565 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemState at 1695931289569 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1695931289580 (+11 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695931289590 (+10 ms) 2023-09-28 20:01:29,594 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-28 20:01:29,596 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 182 msec 2023-09-28 20:01:29,711 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 20:01:29,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-28 20:01:29,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-28 20:01:29,717 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38759] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1695931288725.eeac3214eb65fd0b6475ef99f06e595a. with WAL disabled. Data may be lost in the event of a crash. 2023-09-28 20:01:29,719 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1695931288725.d4340ba4962a89c2bfd1eaad9f37fdd6. with WAL disabled. Data may be lost in the event of a crash. 2023-09-28 20:01:29,724 DEBUG [Listener at jenkins-hbase4.apache.org/41509] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-28 20:01:29,724 DEBUG [Listener at jenkins-hbase4.apache.org/41509] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695931288725.eeac3214eb65fd0b6475ef99f06e595a. 2023-09-28 20:01:29,725 INFO [Listener at jenkins-hbase4.apache.org/41509] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-28 20:01:29,738 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-28 20:01:29,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695931289738 (current time:1695931289738). 2023-09-28 20:01:29,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-28 20:01:29,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] zookeeper.ReadOnlyZKClient(139): Connect 0x174a20d2 to 127.0.0.1:50329 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 20:01:29,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@785f7248, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 20:01:29,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 20:01:29,750 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55640, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 20:01:29,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x174a20d2 to 127.0.0.1:50329 2023-09-28 20:01:29,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 20:01:29,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] zookeeper.ReadOnlyZKClient(139): Connect 0x63282d3b to 127.0.0.1:50329 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 20:01:29,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@266c36f2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 20:01:29,762 DEBUG [hconnection-0x77d35188-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 20:01:29,763 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55656, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 20:01:29,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x63282d3b to 127.0.0.1:50329 2023-09-28 20:01:29,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 20:01:29,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-28 20:01:29,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-28 20:01:29,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-28 20:01:29,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-28 20:01:29,775 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-28 20:01:29,777 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695931889777 2023-09-28 20:01:29,777 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-28 20:01:29,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-28 20:01:29,779 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-28 20:01:29,779 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-28 20:01:29,780 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-28 20:01:29,781 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-28 20:01:29,783 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 9 msec 2023-09-28 20:01:29,784 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-28 20:01:29,785 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695931889785 2023-09-28 20:01:29,801 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-09-28 20:01:29,801 INFO [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-09-28 20:01:29,801 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 20:01:29,803 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-09-28 20:01:29,803 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-28 20:01:29,804 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 20:01:29,804 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-28 20:01:29,806 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:01:29,806 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:01:29,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:01:29,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:01:29,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:01:29,806 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:01:29,806 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:29,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:01:29,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:01:29,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:01:29,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-28 20:01:29,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-28 20:01:29,807 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:29,807 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:29,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-28 20:01:29,807 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:29,807 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-28 20:01:29,807 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 20:01:29,807 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 20:01:29,808 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 20:01:29,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-28 20:01:29,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-28 20:01:29,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-28 20:01:29,808 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-28 20:01:29,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-28 20:01:29,809 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-28 20:01:29,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-28 20:01:29,809 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-28 20:01:29,809 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-28 20:01:29,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-28 20:01:29,809 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 20:01:29,809 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-28 20:01:29,811 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-28 20:01:29,811 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-28 20:01:29,811 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-28 20:01:29,811 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 20:01:29,811 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-28 20:01:29,811 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-28 20:01:29,812 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-28 20:01:29,812 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 20:01:29,812 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-28 20:01:29,814 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-28 20:01:29,812 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46795,1695931262192' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-28 20:01:29,814 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-28 20:01:29,814 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-28 20:01:29,814 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33091,1695931262281' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-28 20:01:29,814 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38759,1695931262240' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-28 20:01:29,816 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:29,816 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 20:01:29,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:29,816 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 20:01:29,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:01:29,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:01:29,817 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:29,818 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 20:01:29,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:01:29,818 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 20:01:29,818 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 20:01:29,818 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 20:01:29,818 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 20:01:29,818 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 20:01:29,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:01:29,818 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 20:01:29,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-28 20:01:29,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:29,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:29,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:29,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:01:29,820 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33091,1695931262281' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-28 20:01:29,820 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2aeea7de[Count = 1] remaining members to acquire global barrier 2023-09-28 20:01:29,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:29,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:01:29,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:01:29,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:01:29,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:01:29,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-28 20:01:29,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:29,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:29,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:29,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:01:29,822 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38759,1695931262240' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-28 20:01:29,822 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2aeea7de[Count = 0] remaining members to acquire global barrier 2023-09-28 20:01:29,822 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-28 20:01:29,823 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 20:01:29,824 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 20:01:29,824 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 20:01:29,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 20:01:29,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 20:01:29,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 20:01:29,824 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 20:01:29,824 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-28 20:01:29,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 20:01:29,824 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-28 20:01:29,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 20:01:29,824 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:29,824 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-28 20:01:29,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 20:01:29,824 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46795,1695931262192' in zk 2023-09-28 20:01:29,824 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-28 20:01:29,824 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 20:01:29,825 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 20:01:29,825 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695931288725.eeac3214eb65fd0b6475ef99f06e595a. 2023-09-28 20:01:29,825 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:29,825 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-28 20:01:29,825 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 20:01:29,825 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 20:01:29,825 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695931288725.d4340ba4962a89c2bfd1eaad9f37fdd6. 2023-09-28 20:01:29,825 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695931288725.eeac3214eb65fd0b6475ef99f06e595a. started... 2023-09-28 20:01:29,825 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695931288725.d4340ba4962a89c2bfd1eaad9f37fdd6. started... 2023-09-28 20:01:29,825 INFO [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] regionserver.HRegion(2745): Flushing eeac3214eb65fd0b6475ef99f06e595a 1/1 column families, dataSize=132 B heapSize=544 B 2023-09-28 20:01:29,825 INFO [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d4340ba4962a89c2bfd1eaad9f37fdd6 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-09-28 20:01:29,826 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-28 20:01:29,826 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 20:01:29,826 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-28 20:01:29,857 INFO [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230928b9896a7320c341aa870bb6da90e9cb78 to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230928b9896a7320c341aa870bb6da90e9cb78 2023-09-28 20:01:29,859 INFO [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309287e8fcb27ad2b401d97bea084050bd7a6 to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309287e8fcb27ad2b401d97bea084050bd7a6 2023-09-28 20:01:29,879 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 20:01:29,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-28 20:01:29,885 INFO [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemState/eeac3214eb65fd0b6475ef99f06e595a/.tmp/cf/ac0e39de4e004081ac871cb320055408 2023-09-28 20:01:29,885 INFO [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemState/d4340ba4962a89c2bfd1eaad9f37fdd6/.tmp/cf/20e71a78be5c4a92bee9b7645ff367a6 2023-09-28 20:01:29,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-28 20:01:29,885 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-28 20:01:29,893 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemState/eeac3214eb65fd0b6475ef99f06e595a/.tmp/cf/ac0e39de4e004081ac871cb320055408 as hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemState/eeac3214eb65fd0b6475ef99f06e595a/cf/ac0e39de4e004081ac871cb320055408 2023-09-28 20:01:29,893 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemState/d4340ba4962a89c2bfd1eaad9f37fdd6/.tmp/cf/20e71a78be5c4a92bee9b7645ff367a6 as hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemState/d4340ba4962a89c2bfd1eaad9f37fdd6/cf/20e71a78be5c4a92bee9b7645ff367a6 2023-09-28 20:01:29,900 INFO [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemState/d4340ba4962a89c2bfd1eaad9f37fdd6/cf/20e71a78be5c4a92bee9b7645ff367a6, entries=48, sequenceid=6, filesize=13.0 K 2023-09-28 20:01:29,900 INFO [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemState/eeac3214eb65fd0b6475ef99f06e595a/cf/ac0e39de4e004081ac871cb320055408, entries=2, sequenceid=6, filesize=5.2 K 2023-09-28 20:01:29,901 INFO [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for eeac3214eb65fd0b6475ef99f06e595a in 76ms, sequenceid=6, compaction requested=false 2023-09-28 20:01:29,902 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-09-28 20:01:29,902 INFO [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for d4340ba4962a89c2bfd1eaad9f37fdd6 in 77ms, sequenceid=6, compaction requested=false 2023-09-28 20:01:29,902 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for eeac3214eb65fd0b6475ef99f06e595a: 2023-09-28 20:01:29,904 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d4340ba4962a89c2bfd1eaad9f37fdd6: 2023-09-28 20:01:29,905 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695931288725.eeac3214eb65fd0b6475ef99f06e595a.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-28 20:01:29,905 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695931288725.d4340ba4962a89c2bfd1eaad9f37fdd6.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-28 20:01:29,905 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 20:01:29,905 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 20:01:29,905 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemState/eeac3214eb65fd0b6475ef99f06e595a/cf/ac0e39de4e004081ac871cb320055408] hfiles 2023-09-28 20:01:29,905 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemState/d4340ba4962a89c2bfd1eaad9f37fdd6/cf/20e71a78be5c4a92bee9b7645ff367a6] hfiles 2023-09-28 20:01:29,905 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemState/eeac3214eb65fd0b6475ef99f06e595a/cf/ac0e39de4e004081ac871cb320055408 for snapshot=snaptb0-testExportFileSystemState 2023-09-28 20:01:29,905 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemState/d4340ba4962a89c2bfd1eaad9f37fdd6/cf/20e71a78be5c4a92bee9b7645ff367a6 for snapshot=snaptb0-testExportFileSystemState 2023-09-28 20:01:29,924 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695931288725.d4340ba4962a89c2bfd1eaad9f37fdd6. completed. 2023-09-28 20:01:29,924 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695931288725.d4340ba4962a89c2bfd1eaad9f37fdd6. 2023-09-28 20:01:29,925 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 20:01:29,925 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 20:01:29,925 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:29,925 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-28 20:01:29,925 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33091,1695931262281' in zk 2023-09-28 20:01:29,926 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695931288725.eeac3214eb65fd0b6475ef99f06e595a. completed. 2023-09-28 20:01:29,927 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695931288725.eeac3214eb65fd0b6475ef99f06e595a. 2023-09-28 20:01:29,927 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 20:01:29,927 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 20:01:29,927 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:29,927 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-28 20:01:29,927 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38759,1695931262240' in zk 2023-09-28 20:01:29,931 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-28 20:01:29,931 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:29,931 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 20:01:29,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:29,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:01:29,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:01:29,931 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-28 20:01:29,934 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-28 20:01:29,934 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:29,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:01:29,934 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 20:01:29,934 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-28 20:01:29,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:01:29,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-28 20:01:29,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:29,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:29,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:29,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:01:29,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-28 20:01:29,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:29,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:29,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:29,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,33091,1695931262281': 2023-09-28 20:01:29,939 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33091,1695931262281' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-28 20:01:29,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:29,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:01:29,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:01:29,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:01:29,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:01:29,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-28 20:01:29,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:29,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:29,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:29,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:01:29,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-28 20:01:29,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:29,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:29,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:29,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,38759,1695931262240': 2023-09-28 20:01:29,942 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38759,1695931262240' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-28 20:01:29,942 INFO [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-09-28 20:01:29,942 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-28 20:01:29,942 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-28 20:01:29,942 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-09-28 20:01:29,942 INFO [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-28 20:01:29,944 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 20:01:29,944 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 20:01:29,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 20:01:29,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 20:01:29,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 20:01:29,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:01:29,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:01:29,944 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:01:29,944 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 20:01:29,944 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 20:01:29,944 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:01:29,944 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:01:29,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 20:01:29,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:01:29,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 20:01:29,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:01:29,945 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:29,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 20:01:29,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 20:01:29,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 20:01:29,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:01:29,945 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:29,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:01:29,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:01:29,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:01:29,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:01:29,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-28 20:01:29,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 20:01:29,946 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:29,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 20:01:29,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:01:29,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-28 20:01:29,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:29,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:29,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:29,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:01:29,948 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:29,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-28 20:01:29,948 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:29,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:29,949 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:29,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:29,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:29,953 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:29,953 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-28 20:01:29,953 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:29,953 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:01:29,953 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:01:29,953 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:01:29,953 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:29,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:01:29,953 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:01:29,953 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-09-28 20:01:29,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:01:29,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:01:29,953 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:01:29,954 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:01:29,953 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-28 20:01:29,953 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 20:01:29,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:01:29,953 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-28 20:01:29,954 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-28 20:01:29,956 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:29,956 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-28 20:01:29,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:01:29,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:01:29,956 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 20:01:29,956 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:29,956 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:29,956 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 20:01:29,956 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 20:01:29,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:01:29,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:01:29,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:01:29,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:01:29,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:01:29,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:01:29,957 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230928b9896a7320c341aa870bb6da90e9cb78, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309287e8fcb27ad2b401d97bea084050bd7a6] mob files 2023-09-28 20:01:29,957 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230928b9896a7320c341aa870bb6da90e9cb78 2023-09-28 20:01:29,957 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309287e8fcb27ad2b401d97bea084050bd7a6 2023-09-28 20:01:29,968 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-09-28 20:01:29,969 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-28 20:01:30,000 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-28 20:01:30,001 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-28 20:01:30,001 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-28 20:01:30,002 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-28 20:01:30,002 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695931289777Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695931289968 (+191 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1695931289968Loading Region manifests for snaptb0-testExportFileSystemState at 1695931289968Writing data manifest for snaptb0-testExportFileSystemState at 1695931289972 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1695931289989 (+17 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695931290001 (+12 ms) 2023-09-28 20:01:30,005 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-28 20:01:30,007 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 227 msec 2023-09-28 20:01:30,086 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 20:01:30,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-28 20:01:30,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-28 20:01:30,087 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/export-test/export-1695931290087 2023-09-28 20:01:30,088 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43143, tgtDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/export-test/export-1695931290087, rawTgtDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/export-test/export-1695931290087, srcFsUri=hdfs://localhost:43143, srcDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff 2023-09-28 20:01:30,121 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43143, inputRoot=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff 2023-09-28 20:01:30,122 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_492995440_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/export-test/export-1695931290087, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/export-test/export-1695931290087/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-28 20:01:30,122 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43143, inputRoot=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff, snapshotDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-09-28 20:01:30,137 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/export-test/export-1695931290087/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-28 20:01:30,171 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-28 20:01:30,172 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-28 20:01:30,172 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-28 20:01:30,173 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-28 20:01:31,086 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/hadoop-1274504770599619414.jar 2023-09-28 20:01:31,087 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-28 20:01:31,087 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-28 20:01:31,157 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/hadoop-2069316784354775038.jar 2023-09-28 20:01:31,158 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-28 20:01:31,158 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-28 20:01:31,158 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-28 20:01:31,159 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-28 20:01:31,159 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-28 20:01:31,159 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-28 20:01:31,160 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-28 20:01:31,160 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-28 20:01:31,161 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-28 20:01:31,161 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-28 20:01:31,161 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-28 20:01:31,162 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-28 20:01:31,162 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-28 20:01:31,163 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-28 20:01:31,163 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-28 20:01:31,163 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-28 20:01:31,164 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 20:01:31,164 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 20:01:31,165 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 20:01:31,165 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 20:01:31,166 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 20:01:31,166 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 20:01:31,167 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 20:01:32,028 WARN [Listener at jenkins-hbase4.apache.org/41509] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-28 20:01:32,031 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-09-28 20:01:32,034 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-28 20:01:32,487 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 20:01:32,487 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 20:01:32,494 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695931268848_0001_000001 (auth:SIMPLE) 2023-09-28 20:01:33,291 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695931268848_0002_000001 (auth:SIMPLE) 2023-09-28 20:01:34,029 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-28 20:01:37,592 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695931268848_0002_000001 (auth:SIMPLE) 2023-09-28 20:01:39,819 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695931268848_0002_000001 (auth:SIMPLE) 2023-09-28 20:01:42,417 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695931268848_0002_000001 (auth:SIMPLE) 2023-09-28 20:01:44,230 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-28 20:01:44,231 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-28 20:01:44,240 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-09-28 20:01:44,240 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-28 20:01:44,241 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-28 20:01:44,241 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_394157282_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-28 20:01:44,241 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(367): hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-28 20:01:44,241 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(367): hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-28 20:01:44,241 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_394157282_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/export-test/export-1695931290087/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/export-test/export-1695931290087/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-28 20:01:44,242 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(367): hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/export-test/export-1695931290087/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-28 20:01:44,242 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(367): hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/export-test/export-1695931290087/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-28 20:01:44,249 INFO [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-09-28 20:01:44,250 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-09-28 20:01:44,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-09-28 20:01:44,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-28 20:01:44,255 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695931304255"}]},"ts":"1695931304255"} 2023-09-28 20:01:44,256 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-09-28 20:01:44,259 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-09-28 20:01:44,260 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=eeac3214eb65fd0b6475ef99f06e595a, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d4340ba4962a89c2bfd1eaad9f37fdd6, UNASSIGN}] 2023-09-28 20:01:44,262 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d4340ba4962a89c2bfd1eaad9f37fdd6, UNASSIGN 2023-09-28 20:01:44,262 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=eeac3214eb65fd0b6475ef99f06e595a, UNASSIGN 2023-09-28 20:01:44,263 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=d4340ba4962a89c2bfd1eaad9f37fdd6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:44,263 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695931288725.d4340ba4962a89c2bfd1eaad9f37fdd6.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695931304263"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695931304263"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695931304263"}]},"ts":"1695931304263"} 2023-09-28 20:01:44,264 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=eeac3214eb65fd0b6475ef99f06e595a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:44,264 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695931288725.eeac3214eb65fd0b6475ef99f06e595a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695931304264"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695931304264"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695931304264"}]},"ts":"1695931304264"} 2023-09-28 20:01:44,265 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure d4340ba4962a89c2bfd1eaad9f37fdd6, server=jenkins-hbase4.apache.org,33091,1695931262281}] 2023-09-28 20:01:44,266 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure eeac3214eb65fd0b6475ef99f06e595a, server=jenkins-hbase4.apache.org,38759,1695931262240}] 2023-09-28 20:01:44,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-28 20:01:44,418 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d4340ba4962a89c2bfd1eaad9f37fdd6 2023-09-28 20:01:44,418 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d4340ba4962a89c2bfd1eaad9f37fdd6, disabling compactions & flushes 2023-09-28 20:01:44,418 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695931288725.d4340ba4962a89c2bfd1eaad9f37fdd6. 2023-09-28 20:01:44,418 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695931288725.d4340ba4962a89c2bfd1eaad9f37fdd6. 2023-09-28 20:01:44,418 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695931288725.d4340ba4962a89c2bfd1eaad9f37fdd6. after waiting 0 ms 2023-09-28 20:01:44,418 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695931288725.d4340ba4962a89c2bfd1eaad9f37fdd6. 2023-09-28 20:01:44,419 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close eeac3214eb65fd0b6475ef99f06e595a 2023-09-28 20:01:44,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing eeac3214eb65fd0b6475ef99f06e595a, disabling compactions & flushes 2023-09-28 20:01:44,422 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695931288725.eeac3214eb65fd0b6475ef99f06e595a. 2023-09-28 20:01:44,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695931288725.eeac3214eb65fd0b6475ef99f06e595a. 2023-09-28 20:01:44,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695931288725.eeac3214eb65fd0b6475ef99f06e595a. after waiting 0 ms 2023-09-28 20:01:44,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695931288725.eeac3214eb65fd0b6475ef99f06e595a. 2023-09-28 20:01:44,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemState/d4340ba4962a89c2bfd1eaad9f37fdd6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-28 20:01:44,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemState/eeac3214eb65fd0b6475ef99f06e595a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-28 20:01:44,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 20:01:44,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 20:01:44,436 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695931288725.d4340ba4962a89c2bfd1eaad9f37fdd6. 2023-09-28 20:01:44,437 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695931288725.eeac3214eb65fd0b6475ef99f06e595a. 2023-09-28 20:01:44,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d4340ba4962a89c2bfd1eaad9f37fdd6: 2023-09-28 20:01:44,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for eeac3214eb65fd0b6475ef99f06e595a: 2023-09-28 20:01:44,438 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d4340ba4962a89c2bfd1eaad9f37fdd6 2023-09-28 20:01:44,439 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=d4340ba4962a89c2bfd1eaad9f37fdd6, regionState=CLOSED 2023-09-28 20:01:44,439 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695931288725.d4340ba4962a89c2bfd1eaad9f37fdd6.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695931304439"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695931304439"}]},"ts":"1695931304439"} 2023-09-28 20:01:44,439 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed eeac3214eb65fd0b6475ef99f06e595a 2023-09-28 20:01:44,440 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=eeac3214eb65fd0b6475ef99f06e595a, regionState=CLOSED 2023-09-28 20:01:44,440 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695931288725.eeac3214eb65fd0b6475ef99f06e595a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695931304440"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695931304440"}]},"ts":"1695931304440"} 2023-09-28 20:01:44,443 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=38 2023-09-28 20:01:44,443 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure d4340ba4962a89c2bfd1eaad9f37fdd6, server=jenkins-hbase4.apache.org,33091,1695931262281 in 176 msec 2023-09-28 20:01:44,444 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=37 2023-09-28 20:01:44,444 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure eeac3214eb65fd0b6475ef99f06e595a, server=jenkins-hbase4.apache.org,38759,1695931262240 in 176 msec 2023-09-28 20:01:44,445 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d4340ba4962a89c2bfd1eaad9f37fdd6, UNASSIGN in 183 msec 2023-09-28 20:01:44,446 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-09-28 20:01:44,446 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=eeac3214eb65fd0b6475ef99f06e595a, UNASSIGN in 184 msec 2023-09-28 20:01:44,446 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695931304446"}]},"ts":"1695931304446"} 2023-09-28 20:01:44,448 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-09-28 20:01:44,449 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-09-28 20:01:44,452 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 200 msec 2023-09-28 20:01:44,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-28 20:01:44,558 INFO [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-09-28 20:01:44,559 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-09-28 20:01:44,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-28 20:01:44,563 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-28 20:01:44,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-09-28 20:01:44,564 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-28 20:01:44,565 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33091] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-09-28 20:01:44,567 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-28 20:01:44,567 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-28 20:01:44,567 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-28 20:01:44,567 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-28 20:01:44,568 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-28 20:01:44,568 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-28 20:01:44,568 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-28 20:01:44,568 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-28 20:01:44,569 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemState/eeac3214eb65fd0b6475ef99f06e595a 2023-09-28 20:01:44,569 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemState/d4340ba4962a89c2bfd1eaad9f37fdd6 2023-09-28 20:01:44,571 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-28 20:01:44,571 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-28 20:01:44,571 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 20:01:44,571 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-28 20:01:44,571 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-28 20:01:44,571 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemState/eeac3214eb65fd0b6475ef99f06e595a/cf, FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemState/eeac3214eb65fd0b6475ef99f06e595a/recovered.edits] 2023-09-28 20:01:44,571 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemState/d4340ba4962a89c2bfd1eaad9f37fdd6/cf, FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemState/d4340ba4962a89c2bfd1eaad9f37fdd6/recovered.edits] 2023-09-28 20:01:44,571 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 20:01:44,571 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 20:01:44,571 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 20:01:44,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-28 20:01:44,576 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemState/d4340ba4962a89c2bfd1eaad9f37fdd6/cf/20e71a78be5c4a92bee9b7645ff367a6 to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/archive/data/default/testtb-testExportFileSystemState/d4340ba4962a89c2bfd1eaad9f37fdd6/cf/20e71a78be5c4a92bee9b7645ff367a6 2023-09-28 20:01:44,576 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemState/eeac3214eb65fd0b6475ef99f06e595a/cf/ac0e39de4e004081ac871cb320055408 to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/archive/data/default/testtb-testExportFileSystemState/eeac3214eb65fd0b6475ef99f06e595a/cf/ac0e39de4e004081ac871cb320055408 2023-09-28 20:01:44,579 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemState/d4340ba4962a89c2bfd1eaad9f37fdd6/recovered.edits/9.seqid to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/archive/data/default/testtb-testExportFileSystemState/d4340ba4962a89c2bfd1eaad9f37fdd6/recovered.edits/9.seqid 2023-09-28 20:01:44,579 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemState/eeac3214eb65fd0b6475ef99f06e595a/recovered.edits/9.seqid to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/archive/data/default/testtb-testExportFileSystemState/eeac3214eb65fd0b6475ef99f06e595a/recovered.edits/9.seqid 2023-09-28 20:01:44,580 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemState/d4340ba4962a89c2bfd1eaad9f37fdd6 2023-09-28 20:01:44,580 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemState/eeac3214eb65fd0b6475ef99f06e595a 2023-09-28 20:01:44,580 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-28 20:01:44,581 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-28 20:01:44,581 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-09-28 20:01:44,585 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230928b9896a7320c341aa870bb6da90e9cb78 to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230928b9896a7320c341aa870bb6da90e9cb78 2023-09-28 20:01:44,586 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309287e8fcb27ad2b401d97bea084050bd7a6 to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309287e8fcb27ad2b401d97bea084050bd7a6 2023-09-28 20:01:44,587 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-28 20:01:44,589 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-28 20:01:44,592 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-09-28 20:01:44,594 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-09-28 20:01:44,596 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-28 20:01:44,596 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-09-28 20:01:44,597 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1695931288725.eeac3214eb65fd0b6475ef99f06e595a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695931304596"}]},"ts":"9223372036854775807"} 2023-09-28 20:01:44,597 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1695931288725.d4340ba4962a89c2bfd1eaad9f37fdd6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695931304596"}]},"ts":"9223372036854775807"} 2023-09-28 20:01:44,599 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-28 20:01:44,599 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => eeac3214eb65fd0b6475ef99f06e595a, NAME => 'testtb-testExportFileSystemState,,1695931288725.eeac3214eb65fd0b6475ef99f06e595a.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => d4340ba4962a89c2bfd1eaad9f37fdd6, NAME => 'testtb-testExportFileSystemState,1,1695931288725.d4340ba4962a89c2bfd1eaad9f37fdd6.', STARTKEY => '1', ENDKEY => ''}] 2023-09-28 20:01:44,599 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-09-28 20:01:44,599 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695931304599"}]},"ts":"9223372036854775807"} 2023-09-28 20:01:44,602 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-09-28 20:01:44,604 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-28 20:01:44,606 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 45 msec 2023-09-28 20:01:44,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-28 20:01:44,674 INFO [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-09-28 20:01:44,683 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-09-28 20:01:44,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-09-28 20:01:44,687 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-09-28 20:01:44,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-09-28 20:01:44,714 INFO [Listener at jenkins-hbase4.apache.org/41509] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=767 (was 758) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1dd01c2f-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_394157282_17 at /127.0.0.1:43684 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1dd01c2f-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_394157282_17 at /127.0.0.1:45412 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:41873 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Thread-2082 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_394157282_17 at /127.0.0.1:52860 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1171915843_1 at /127.0.0.1:43670 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1171915843_1 at /127.0.0.1:52832 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1dd01c2f-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1dd01c2f-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=925 (was 935), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=285 (was 285), ProcessCount=168 (was 168), AvailableMemoryMB=4715 (was 4818) 2023-09-28 20:01:44,715 WARN [Listener at jenkins-hbase4.apache.org/41509] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-09-28 20:01:44,738 INFO [Listener at jenkins-hbase4.apache.org/41509] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=767, OpenFileDescriptor=925, MaxFileDescriptor=60000, SystemLoadAverage=285, ProcessCount=168, AvailableMemoryMB=4715 2023-09-28 20:01:44,738 WARN [Listener at jenkins-hbase4.apache.org/41509] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-09-28 20:01:44,740 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-28 20:01:44,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-09-28 20:01:44,745 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-09-28 20:01:44,745 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-09-28 20:01:44,746 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-28 20:01:44,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-28 20:01:44,749 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testConsecutiveExports/180277fcc588175ceffd55fdec8db473 2023-09-28 20:01:44,749 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testConsecutiveExports/ff8c510f9367a5ab781d765159352ac4 2023-09-28 20:01:44,750 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testConsecutiveExports/180277fcc588175ceffd55fdec8db473 empty. 2023-09-28 20:01:44,750 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testConsecutiveExports/ff8c510f9367a5ab781d765159352ac4 empty. 2023-09-28 20:01:44,751 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testConsecutiveExports/180277fcc588175ceffd55fdec8db473 2023-09-28 20:01:44,751 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testConsecutiveExports/ff8c510f9367a5ab781d765159352ac4 2023-09-28 20:01:44,751 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-28 20:01:44,770 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-09-28 20:01:44,771 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 180277fcc588175ceffd55fdec8db473, NAME => 'testtb-testConsecutiveExports,,1695931304740.180277fcc588175ceffd55fdec8db473.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp 2023-09-28 20:01:44,772 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => ff8c510f9367a5ab781d765159352ac4, NAME => 'testtb-testConsecutiveExports,1,1695931304740.ff8c510f9367a5ab781d765159352ac4.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp 2023-09-28 20:01:44,790 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695931304740.ff8c510f9367a5ab781d765159352ac4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 20:01:44,790 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing ff8c510f9367a5ab781d765159352ac4, disabling compactions & flushes 2023-09-28 20:01:44,790 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695931304740.ff8c510f9367a5ab781d765159352ac4. 2023-09-28 20:01:44,790 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695931304740.ff8c510f9367a5ab781d765159352ac4. 2023-09-28 20:01:44,790 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695931304740.ff8c510f9367a5ab781d765159352ac4. after waiting 0 ms 2023-09-28 20:01:44,790 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695931304740.ff8c510f9367a5ab781d765159352ac4. 2023-09-28 20:01:44,790 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695931304740.ff8c510f9367a5ab781d765159352ac4. 2023-09-28 20:01:44,790 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for ff8c510f9367a5ab781d765159352ac4: 2023-09-28 20:01:44,796 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695931304740.180277fcc588175ceffd55fdec8db473.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 20:01:44,796 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 180277fcc588175ceffd55fdec8db473, disabling compactions & flushes 2023-09-28 20:01:44,796 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695931304740.180277fcc588175ceffd55fdec8db473. 2023-09-28 20:01:44,796 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695931304740.180277fcc588175ceffd55fdec8db473. 2023-09-28 20:01:44,796 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695931304740.180277fcc588175ceffd55fdec8db473. after waiting 0 ms 2023-09-28 20:01:44,796 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695931304740.180277fcc588175ceffd55fdec8db473. 2023-09-28 20:01:44,796 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695931304740.180277fcc588175ceffd55fdec8db473. 2023-09-28 20:01:44,796 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 180277fcc588175ceffd55fdec8db473: 2023-09-28 20:01:44,799 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-09-28 20:01:44,800 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695931304740.ff8c510f9367a5ab781d765159352ac4.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695931304800"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695931304800"}]},"ts":"1695931304800"} 2023-09-28 20:01:44,801 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695931304740.180277fcc588175ceffd55fdec8db473.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695931304800"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695931304800"}]},"ts":"1695931304800"} 2023-09-28 20:01:44,803 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-28 20:01:44,804 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-28 20:01:44,805 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695931304804"}]},"ts":"1695931304804"} 2023-09-28 20:01:44,806 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-09-28 20:01:44,810 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-28 20:01:44,811 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-28 20:01:44,811 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-28 20:01:44,811 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-28 20:01:44,811 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-28 20:01:44,811 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=180277fcc588175ceffd55fdec8db473, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ff8c510f9367a5ab781d765159352ac4, ASSIGN}] 2023-09-28 20:01:44,815 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=180277fcc588175ceffd55fdec8db473, ASSIGN 2023-09-28 20:01:44,815 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ff8c510f9367a5ab781d765159352ac4, ASSIGN 2023-09-28 20:01:44,816 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=180277fcc588175ceffd55fdec8db473, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46795,1695931262192; forceNewPlan=false, retain=false 2023-09-28 20:01:44,816 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ff8c510f9367a5ab781d765159352ac4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38759,1695931262240; forceNewPlan=false, retain=false 2023-09-28 20:01:44,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-28 20:01:44,966 INFO [jenkins-hbase4:35173] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-28 20:01:44,969 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=180277fcc588175ceffd55fdec8db473, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:44,969 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=ff8c510f9367a5ab781d765159352ac4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:44,969 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695931304740.180277fcc588175ceffd55fdec8db473.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695931304969"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695931304969"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695931304969"}]},"ts":"1695931304969"} 2023-09-28 20:01:44,969 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695931304740.ff8c510f9367a5ab781d765159352ac4.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695931304969"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695931304969"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695931304969"}]},"ts":"1695931304969"} 2023-09-28 20:01:44,971 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 180277fcc588175ceffd55fdec8db473, server=jenkins-hbase4.apache.org,46795,1695931262192}] 2023-09-28 20:01:44,972 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure ff8c510f9367a5ab781d765159352ac4, server=jenkins-hbase4.apache.org,38759,1695931262240}] 2023-09-28 20:01:45,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-28 20:01:45,131 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1695931304740.180277fcc588175ceffd55fdec8db473. 2023-09-28 20:01:45,131 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1695931304740.ff8c510f9367a5ab781d765159352ac4. 2023-09-28 20:01:45,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 180277fcc588175ceffd55fdec8db473, NAME => 'testtb-testConsecutiveExports,,1695931304740.180277fcc588175ceffd55fdec8db473.', STARTKEY => '', ENDKEY => '1'} 2023-09-28 20:01:45,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ff8c510f9367a5ab781d765159352ac4, NAME => 'testtb-testConsecutiveExports,1,1695931304740.ff8c510f9367a5ab781d765159352ac4.', STARTKEY => '1', ENDKEY => ''} 2023-09-28 20:01:45,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1695931304740.180277fcc588175ceffd55fdec8db473. service=AccessControlService 2023-09-28 20:01:45,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1695931304740.ff8c510f9367a5ab781d765159352ac4. service=AccessControlService 2023-09-28 20:01:45,131 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 20:01:45,131 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 20:01:45,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 180277fcc588175ceffd55fdec8db473 2023-09-28 20:01:45,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports ff8c510f9367a5ab781d765159352ac4 2023-09-28 20:01:45,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695931304740.180277fcc588175ceffd55fdec8db473.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 20:01:45,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695931304740.ff8c510f9367a5ab781d765159352ac4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 20:01:45,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 180277fcc588175ceffd55fdec8db473 2023-09-28 20:01:45,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ff8c510f9367a5ab781d765159352ac4 2023-09-28 20:01:45,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 180277fcc588175ceffd55fdec8db473 2023-09-28 20:01:45,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ff8c510f9367a5ab781d765159352ac4 2023-09-28 20:01:45,133 INFO [StoreOpener-180277fcc588175ceffd55fdec8db473-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 180277fcc588175ceffd55fdec8db473 2023-09-28 20:01:45,133 INFO [StoreOpener-ff8c510f9367a5ab781d765159352ac4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ff8c510f9367a5ab781d765159352ac4 2023-09-28 20:01:45,134 DEBUG [StoreOpener-180277fcc588175ceffd55fdec8db473-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testConsecutiveExports/180277fcc588175ceffd55fdec8db473/cf 2023-09-28 20:01:45,135 DEBUG [StoreOpener-ff8c510f9367a5ab781d765159352ac4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testConsecutiveExports/ff8c510f9367a5ab781d765159352ac4/cf 2023-09-28 20:01:45,135 DEBUG [StoreOpener-ff8c510f9367a5ab781d765159352ac4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testConsecutiveExports/ff8c510f9367a5ab781d765159352ac4/cf 2023-09-28 20:01:45,135 DEBUG [StoreOpener-180277fcc588175ceffd55fdec8db473-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testConsecutiveExports/180277fcc588175ceffd55fdec8db473/cf 2023-09-28 20:01:45,135 INFO [StoreOpener-180277fcc588175ceffd55fdec8db473-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 180277fcc588175ceffd55fdec8db473 columnFamilyName cf 2023-09-28 20:01:45,135 INFO [StoreOpener-ff8c510f9367a5ab781d765159352ac4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ff8c510f9367a5ab781d765159352ac4 columnFamilyName cf 2023-09-28 20:01:45,137 INFO [StoreOpener-ff8c510f9367a5ab781d765159352ac4-1] regionserver.HStore(310): Store=ff8c510f9367a5ab781d765159352ac4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 20:01:45,137 INFO [StoreOpener-180277fcc588175ceffd55fdec8db473-1] regionserver.HStore(310): Store=180277fcc588175ceffd55fdec8db473/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 20:01:45,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testConsecutiveExports/ff8c510f9367a5ab781d765159352ac4 2023-09-28 20:01:45,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testConsecutiveExports/180277fcc588175ceffd55fdec8db473 2023-09-28 20:01:45,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testConsecutiveExports/ff8c510f9367a5ab781d765159352ac4 2023-09-28 20:01:45,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testConsecutiveExports/180277fcc588175ceffd55fdec8db473 2023-09-28 20:01:45,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 180277fcc588175ceffd55fdec8db473 2023-09-28 20:01:45,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ff8c510f9367a5ab781d765159352ac4 2023-09-28 20:01:45,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testConsecutiveExports/180277fcc588175ceffd55fdec8db473/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 20:01:45,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testConsecutiveExports/ff8c510f9367a5ab781d765159352ac4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 20:01:45,144 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 180277fcc588175ceffd55fdec8db473; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70103485, jitterRate=0.04462333023548126}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 20:01:45,144 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ff8c510f9367a5ab781d765159352ac4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62438603, jitterRate=-0.06959231197834015}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 20:01:45,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 180277fcc588175ceffd55fdec8db473: 2023-09-28 20:01:45,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ff8c510f9367a5ab781d765159352ac4: 2023-09-28 20:01:45,146 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1695931304740.180277fcc588175ceffd55fdec8db473., pid=45, masterSystemTime=1695931305123 2023-09-28 20:01:45,146 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1695931304740.ff8c510f9367a5ab781d765159352ac4., pid=46, masterSystemTime=1695931305125 2023-09-28 20:01:45,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1695931304740.180277fcc588175ceffd55fdec8db473. 2023-09-28 20:01:45,148 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1695931304740.180277fcc588175ceffd55fdec8db473. 2023-09-28 20:01:45,148 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=180277fcc588175ceffd55fdec8db473, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:45,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1695931304740.ff8c510f9367a5ab781d765159352ac4. 2023-09-28 20:01:45,148 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1695931304740.180277fcc588175ceffd55fdec8db473.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695931305148"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695931305148"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695931305148"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695931305148"}]},"ts":"1695931305148"} 2023-09-28 20:01:45,148 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1695931304740.ff8c510f9367a5ab781d765159352ac4. 2023-09-28 20:01:45,149 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=ff8c510f9367a5ab781d765159352ac4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:45,149 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1695931304740.ff8c510f9367a5ab781d765159352ac4.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695931305149"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695931305149"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695931305149"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695931305149"}]},"ts":"1695931305149"} 2023-09-28 20:01:45,153 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=43 2023-09-28 20:01:45,153 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 180277fcc588175ceffd55fdec8db473, server=jenkins-hbase4.apache.org,46795,1695931262192 in 179 msec 2023-09-28 20:01:45,154 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=44 2023-09-28 20:01:45,154 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure ff8c510f9367a5ab781d765159352ac4, server=jenkins-hbase4.apache.org,38759,1695931262240 in 180 msec 2023-09-28 20:01:45,154 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=180277fcc588175ceffd55fdec8db473, ASSIGN in 342 msec 2023-09-28 20:01:45,156 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=42 2023-09-28 20:01:45,157 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ff8c510f9367a5ab781d765159352ac4, ASSIGN in 343 msec 2023-09-28 20:01:45,157 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-28 20:01:45,158 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695931305157"}]},"ts":"1695931305157"} 2023-09-28 20:01:45,159 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-09-28 20:01:45,167 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-09-28 20:01:45,168 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-09-28 20:01:45,170 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33091] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-28 20:01:45,172 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 20:01:45,172 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 20:01:45,172 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 20:01:45,172 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 20:01:45,173 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-28 20:01:45,173 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-28 20:01:45,173 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-28 20:01:45,173 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-28 20:01:45,175 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 433 msec 2023-09-28 20:01:45,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-28 20:01:45,351 INFO [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-09-28 20:01:45,353 DEBUG [Listener at jenkins-hbase4.apache.org/41509] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-28 20:01:45,353 DEBUG [Listener at jenkins-hbase4.apache.org/41509] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695931304740.180277fcc588175ceffd55fdec8db473. 2023-09-28 20:01:45,356 INFO [Listener at jenkins-hbase4.apache.org/41509] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-28 20:01:45,369 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-28 20:01:45,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695931305369 (current time:1695931305369). 2023-09-28 20:01:45,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-28 20:01:45,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] zookeeper.ReadOnlyZKClient(139): Connect 0x4523efc3 to 127.0.0.1:50329 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 20:01:45,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@75f7f02c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 20:01:45,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 20:01:45,380 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35082, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 20:01:45,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4523efc3 to 127.0.0.1:50329 2023-09-28 20:01:45,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 20:01:45,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] zookeeper.ReadOnlyZKClient(139): Connect 0x663d361e to 127.0.0.1:50329 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 20:01:45,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3cba80ed, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 20:01:45,390 DEBUG [hconnection-0x760661c6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 20:01:45,394 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35090, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 20:01:45,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x663d361e to 127.0.0.1:50329 2023-09-28 20:01:45,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 20:01:45,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-28 20:01:45,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-28 20:01:45,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-28 20:01:45,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-28 20:01:45,404 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-28 20:01:45,405 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695931905405 2023-09-28 20:01:45,405 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-28 20:01:45,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-28 20:01:45,406 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-28 20:01:45,406 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-28 20:01:45,407 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-28 20:01:45,410 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-28 20:01:45,412 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 9 msec 2023-09-28 20:01:45,412 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-28 20:01:45,413 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695931905413 2023-09-28 20:01:45,425 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,425 INFO [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-09-28 20:01:45,425 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 20:01:45,427 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-09-28 20:01:45,427 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-28 20:01:45,427 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,427 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,429 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:01:45,429 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:01:45,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:01:45,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:01:45,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:01:45,429 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:45,429 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:01:45,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:01:45,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:01:45,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:01:45,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,430 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:45,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,430 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:45,430 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,430 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,430 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,430 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:45,430 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-28 20:01:45,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-28 20:01:45,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-28 20:01:45,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-28 20:01:45,431 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-28 20:01:45,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,431 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-28 20:01:45,431 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,431 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-28 20:01:45,431 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-28 20:01:45,431 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 20:01:45,431 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,433 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-28 20:01:45,433 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,433 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-28 20:01:45,433 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-28 20:01:45,433 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 20:01:45,433 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 20:01:45,433 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-28 20:01:45,437 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-28 20:01:45,437 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-28 20:01:45,437 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46795,1695931262192' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-28 20:01:45,434 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-28 20:01:45,437 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38759,1695931262240' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-28 20:01:45,438 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-28 20:01:45,438 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33091,1695931262281' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-28 20:01:45,440 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:45,440 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:45,440 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:01:45,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:01:45,441 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:45,441 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,441 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,441 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 20:01:45,441 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,441 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 20:01:45,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:01:45,441 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,441 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 20:01:45,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:01:45,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:45,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:45,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:45,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:01:45,443 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46795,1695931262192' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-28 20:01:45,443 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@36fb8b88[Count = 1] remaining members to acquire global barrier 2023-09-28 20:01:45,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:45,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:01:45,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:01:45,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:01:45,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:01:45,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:45,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:45,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:45,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:01:45,446 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38759,1695931262240' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-28 20:01:45,446 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@36fb8b88[Count = 0] remaining members to acquire global barrier 2023-09-28 20:01:45,446 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-28 20:01:45,446 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,447 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,447 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,447 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,447 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-28 20:01:45,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,447 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-28 20:01:45,447 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 20:01:45,447 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-28 20:01:45,447 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695931304740.180277fcc588175ceffd55fdec8db473. 2023-09-28 20:01:45,447 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:45,448 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 20:01:45,448 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695931304740.180277fcc588175ceffd55fdec8db473. started... 2023-09-28 20:01:45,448 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695931304740.ff8c510f9367a5ab781d765159352ac4. 2023-09-28 20:01:45,447 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 20:01:45,447 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-28 20:01:45,448 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,33091,1695931262281' in zk 2023-09-28 20:01:45,448 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:45,448 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695931304740.ff8c510f9367a5ab781d765159352ac4. started... 2023-09-28 20:01:45,448 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 20:01:45,448 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-28 20:01:45,448 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 180277fcc588175ceffd55fdec8db473: 2023-09-28 20:01:45,450 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ff8c510f9367a5ab781d765159352ac4: 2023-09-28 20:01:45,450 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695931304740.180277fcc588175ceffd55fdec8db473.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,450 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695931304740.ff8c510f9367a5ab781d765159352ac4.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,451 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 20:01:45,451 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 20:01:45,451 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-28 20:01:45,451 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-28 20:01:45,459 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-28 20:01:45,459 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 20:01:45,459 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-28 20:01:45,469 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695931304740.180277fcc588175ceffd55fdec8db473. completed. 2023-09-28 20:01:45,469 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695931304740.180277fcc588175ceffd55fdec8db473. 2023-09-28 20:01:45,469 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 20:01:45,469 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 20:01:45,469 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:45,469 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-28 20:01:45,470 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,46795,1695931262192' in zk 2023-09-28 20:01:45,471 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:45,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:45,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:01:45,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:01:45,472 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-28 20:01:45,472 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 20:01:45,472 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-28 20:01:45,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:01:45,474 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695931304740.ff8c510f9367a5ab781d765159352ac4. completed. 2023-09-28 20:01:45,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:01:45,474 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695931304740.ff8c510f9367a5ab781d765159352ac4. 2023-09-28 20:01:45,474 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 20:01:45,475 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 20:01:45,475 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:45,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,475 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-28 20:01:45,475 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,38759,1695931262240' in zk 2023-09-28 20:01:45,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:45,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:45,476 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:45,476 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-28 20:01:45,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:45,477 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 20:01:45,477 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-28 20:01:45,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:01:45,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:45,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:45,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:45,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,46795,1695931262192': 2023-09-28 20:01:45,480 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46795,1695931262192' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-28 20:01:45,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:45,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:01:45,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:01:45,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:01:45,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:01:45,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:45,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:45,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:45,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:01:45,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:45,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:45,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:45,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,38759,1695931262240': 2023-09-28 20:01:45,488 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38759,1695931262240' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-28 20:01:45,488 INFO [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-09-28 20:01:45,489 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-28 20:01:45,489 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-28 20:01:45,489 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,489 INFO [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-28 20:01:45,492 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,492 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:01:45,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:01:45,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,492 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,492 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:01:45,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,492 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:01:45,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,492 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:01:45,492 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:01:45,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,492 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:45,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:01:45,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:01:45,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:01:45,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:01:45,493 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:45,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:01:45,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:01:45,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:01:45,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,494 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:45,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:45,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:45,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:45,496 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:45,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:01:45,496 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:45,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,497 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:45,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:45,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:45,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:45,500 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:45,500 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,500 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:01:45,500 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:01:45,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:01:45,500 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:01:45,500 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:01:45,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:01:45,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:01:45,500 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:01:45,500 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:45,500 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:01:45,500 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,500 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 20:01:45,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:01:45,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:01:45,500 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-28 20:01:45,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:01:45,500 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:45,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:01:45,502 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,502 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:01:45,502 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-28 20:01:45,502 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:45,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:01:45,503 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:01:45,503 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:45,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:01:45,503 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:45,503 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,503 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:01:45,503 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-28 20:01:45,507 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 20:01:45,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-28 20:01:45,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-28 20:01:45,508 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-28 20:01:45,512 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,513 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,533 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,533 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-28 20:01:45,534 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,534 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-28 20:01:45,534 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695931305405Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695931305512 (+107 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1695931305512Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1695931305512Writing data manifest for emptySnaptb0-testConsecutiveExports at 1695931305518 (+6 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1695931305527 (+9 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695931305533 (+6 ms) 2023-09-28 20:01:45,537 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-28 20:01:45,538 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 131 msec 2023-09-28 20:01:45,708 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 20:01:45,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-28 20:01:45,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-28 20:01:45,712 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46795] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1695931304740.180277fcc588175ceffd55fdec8db473. with WAL disabled. Data may be lost in the event of a crash. 2023-09-28 20:01:45,713 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38759] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1695931304740.ff8c510f9367a5ab781d765159352ac4. with WAL disabled. Data may be lost in the event of a crash. 2023-09-28 20:01:45,717 DEBUG [Listener at jenkins-hbase4.apache.org/41509] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-28 20:01:45,717 DEBUG [Listener at jenkins-hbase4.apache.org/41509] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695931304740.180277fcc588175ceffd55fdec8db473. 2023-09-28 20:01:45,717 INFO [Listener at jenkins-hbase4.apache.org/41509] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-28 20:01:45,728 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-28 20:01:45,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695931305729 (current time:1695931305729). 2023-09-28 20:01:45,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-28 20:01:45,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] zookeeper.ReadOnlyZKClient(139): Connect 0x643b7d07 to 127.0.0.1:50329 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 20:01:45,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3b5745b7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 20:01:45,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 20:01:45,745 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35096, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 20:01:45,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x643b7d07 to 127.0.0.1:50329 2023-09-28 20:01:45,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 20:01:45,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] zookeeper.ReadOnlyZKClient(139): Connect 0x141a0155 to 127.0.0.1:50329 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 20:01:45,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b768594, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 20:01:45,757 DEBUG [hconnection-0x2a8d07b0-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 20:01:45,760 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35102, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 20:01:45,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x141a0155 to 127.0.0.1:50329 2023-09-28 20:01:45,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 20:01:45,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-28 20:01:45,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-28 20:01:45,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-28 20:01:45,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-28 20:01:45,769 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-28 20:01:45,770 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695931905770 2023-09-28 20:01:45,770 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-28 20:01:45,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-28 20:01:45,772 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-28 20:01:45,772 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-28 20:01:45,772 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-28 20:01:45,773 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-28 20:01:45,774 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-09-28 20:01:45,775 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-28 20:01:45,776 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695931905776 2023-09-28 20:01:45,787 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-09-28 20:01:45,788 INFO [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-09-28 20:01:45,788 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 20:01:45,789 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-09-28 20:01:45,789 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-28 20:01:45,790 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 20:01:45,790 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-28 20:01:45,791 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:01:45,791 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:01:45,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:01:45,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:01:45,791 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:01:45,791 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:45,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:01:45,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:01:45,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:01:45,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:01:45,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-28 20:01:45,792 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:45,792 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:45,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-28 20:01:45,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-28 20:01:45,792 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 20:01:45,793 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:45,793 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-28 20:01:45,793 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 20:01:45,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-28 20:01:45,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-28 20:01:45,793 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 20:01:45,793 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-28 20:01:45,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-28 20:01:45,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-28 20:01:45,793 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-28 20:01:45,794 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-28 20:01:45,794 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-28 20:01:45,794 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 20:01:45,794 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-28 20:01:45,796 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-28 20:01:45,796 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-28 20:01:45,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-28 20:01:45,796 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 20:01:45,796 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-28 20:01:45,797 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33091,1695931262281' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-28 20:01:45,797 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-28 20:01:45,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-28 20:01:45,797 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-28 20:01:45,797 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46795,1695931262192' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-28 20:01:45,797 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-28 20:01:45,797 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-28 20:01:45,798 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-28 20:01:45,798 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 20:01:45,799 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-28 20:01:45,799 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-28 20:01:45,799 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38759,1695931262240' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-28 20:01:45,803 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 20:01:45,803 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 20:01:45,803 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 20:01:45,804 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 20:01:45,804 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:45,804 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 20:01:45,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:45,804 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:45,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:01:45,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:01:45,804 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 20:01:45,804 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 20:01:45,804 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 20:01:45,805 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 20:01:45,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:01:45,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:01:45,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-28 20:01:45,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:45,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:45,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:45,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:01:45,807 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38759,1695931262240' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-28 20:01:45,807 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4fe2f2ea[Count = 1] remaining members to acquire global barrier 2023-09-28 20:01:45,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:45,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:01:45,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:01:45,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:01:45,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:01:45,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-28 20:01:45,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:45,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:45,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:45,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:01:45,809 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46795,1695931262192' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-28 20:01:45,809 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4fe2f2ea[Count = 0] remaining members to acquire global barrier 2023-09-28 20:01:45,809 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-28 20:01:45,809 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 20:01:45,810 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 20:01:45,810 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 20:01:45,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 20:01:45,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 20:01:45,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 20:01:45,810 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 20:01:45,810 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-28 20:01:45,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 20:01:45,810 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-28 20:01:45,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 20:01:45,810 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,33091,1695931262281' in zk 2023-09-28 20:01:45,811 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-28 20:01:45,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 20:01:45,811 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:45,811 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-28 20:01:45,811 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 20:01:45,811 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 20:01:45,811 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 20:01:45,811 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 20:01:45,811 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695931304740.180277fcc588175ceffd55fdec8db473. 2023-09-28 20:01:45,811 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695931304740.ff8c510f9367a5ab781d765159352ac4. 2023-09-28 20:01:45,811 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695931304740.180277fcc588175ceffd55fdec8db473. started... 2023-09-28 20:01:45,811 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:45,811 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-28 20:01:45,811 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695931304740.ff8c510f9367a5ab781d765159352ac4. started... 2023-09-28 20:01:45,811 INFO [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 180277fcc588175ceffd55fdec8db473 1/1 column families, dataSize=333 B heapSize=976 B 2023-09-28 20:01:45,812 INFO [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ff8c510f9367a5ab781d765159352ac4 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-09-28 20:01:45,812 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-28 20:01:45,812 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 20:01:45,813 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-28 20:01:45,846 INFO [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230928c680a41c4245428790b0b8ec3861f2f9 to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230928c680a41c4245428790b0b8ec3861f2f9 2023-09-28 20:01:45,848 INFO [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230928c4117cad5e7f4c3cba6506fe87648321 to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230928c4117cad5e7f4c3cba6506fe87648321 2023-09-28 20:01:45,861 INFO [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testConsecutiveExports/180277fcc588175ceffd55fdec8db473/.tmp/cf/d8fca77498a54bafaaa69de49db33341 2023-09-28 20:01:45,862 INFO [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testConsecutiveExports/ff8c510f9367a5ab781d765159352ac4/.tmp/cf/6cf5d1f3c46847c4a1e8e8797cfad735 2023-09-28 20:01:45,868 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testConsecutiveExports/180277fcc588175ceffd55fdec8db473/.tmp/cf/d8fca77498a54bafaaa69de49db33341 as hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testConsecutiveExports/180277fcc588175ceffd55fdec8db473/cf/d8fca77498a54bafaaa69de49db33341 2023-09-28 20:01:45,869 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testConsecutiveExports/ff8c510f9367a5ab781d765159352ac4/.tmp/cf/6cf5d1f3c46847c4a1e8e8797cfad735 as hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testConsecutiveExports/ff8c510f9367a5ab781d765159352ac4/cf/6cf5d1f3c46847c4a1e8e8797cfad735 2023-09-28 20:01:45,872 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 20:01:45,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-28 20:01:45,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-28 20:01:45,873 INFO [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testConsecutiveExports/180277fcc588175ceffd55fdec8db473/cf/d8fca77498a54bafaaa69de49db33341, entries=5, sequenceid=6, filesize=5.7 K 2023-09-28 20:01:45,873 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-28 20:01:45,874 INFO [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 180277fcc588175ceffd55fdec8db473 in 63ms, sequenceid=6, compaction requested=false 2023-09-28 20:01:45,874 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-28 20:01:45,875 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 180277fcc588175ceffd55fdec8db473: 2023-09-28 20:01:45,875 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695931304740.180277fcc588175ceffd55fdec8db473.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-28 20:01:45,875 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 20:01:45,875 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testConsecutiveExports/180277fcc588175ceffd55fdec8db473/cf/d8fca77498a54bafaaa69de49db33341] hfiles 2023-09-28 20:01:45,875 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testConsecutiveExports/180277fcc588175ceffd55fdec8db473/cf/d8fca77498a54bafaaa69de49db33341 for snapshot=snaptb0-testConsecutiveExports 2023-09-28 20:01:45,875 INFO [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testConsecutiveExports/ff8c510f9367a5ab781d765159352ac4/cf/6cf5d1f3c46847c4a1e8e8797cfad735, entries=45, sequenceid=6, filesize=12.4 K 2023-09-28 20:01:45,876 INFO [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for ff8c510f9367a5ab781d765159352ac4 in 64ms, sequenceid=6, compaction requested=false 2023-09-28 20:01:45,878 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ff8c510f9367a5ab781d765159352ac4: 2023-09-28 20:01:45,878 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695931304740.ff8c510f9367a5ab781d765159352ac4.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-28 20:01:45,878 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 20:01:45,878 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testConsecutiveExports/ff8c510f9367a5ab781d765159352ac4/cf/6cf5d1f3c46847c4a1e8e8797cfad735] hfiles 2023-09-28 20:01:45,878 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testConsecutiveExports/ff8c510f9367a5ab781d765159352ac4/cf/6cf5d1f3c46847c4a1e8e8797cfad735 for snapshot=snaptb0-testConsecutiveExports 2023-09-28 20:01:45,889 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695931304740.180277fcc588175ceffd55fdec8db473. completed. 2023-09-28 20:01:45,889 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695931304740.180277fcc588175ceffd55fdec8db473. 2023-09-28 20:01:45,889 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 20:01:45,889 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 20:01:45,889 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:45,889 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-28 20:01:45,889 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,46795,1695931262192' in zk 2023-09-28 20:01:45,892 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695931304740.ff8c510f9367a5ab781d765159352ac4. completed. 2023-09-28 20:01:45,892 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695931304740.ff8c510f9367a5ab781d765159352ac4. 2023-09-28 20:01:45,892 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 20:01:45,892 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 20:01:45,892 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:45,892 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-28 20:01:45,892 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,38759,1695931262240' in zk 2023-09-28 20:01:45,892 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:45,892 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-28 20:01:45,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:45,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:01:45,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:01:45,892 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 20:01:45,892 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-28 20:01:45,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:01:45,896 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:45,896 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-28 20:01:45,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:01:45,896 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 20:01:45,896 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-28 20:01:45,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-28 20:01:45,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:45,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:45,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:45,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:01:45,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-28 20:01:45,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:45,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:45,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:45,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,46795,1695931262192': 2023-09-28 20:01:45,900 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46795,1695931262192' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-28 20:01:45,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:45,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:01:45,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:01:45,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:01:45,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:01:45,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-28 20:01:45,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:45,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:45,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:45,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:01:45,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-28 20:01:45,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:45,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:45,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:45,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,38759,1695931262240': 2023-09-28 20:01:45,904 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38759,1695931262240' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-28 20:01:45,904 INFO [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-09-28 20:01:45,904 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-28 20:01:45,904 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-28 20:01:45,904 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-09-28 20:01:45,904 INFO [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-28 20:01:45,906 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 20:01:45,906 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 20:01:45,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 20:01:45,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 20:01:45,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:01:45,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:01:45,906 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 20:01:45,906 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:01:45,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 20:01:45,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 20:01:45,906 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 20:01:45,906 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:01:45,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 20:01:45,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:01:45,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 20:01:45,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 20:01:45,906 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:45,906 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:01:45,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:01:45,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:01:45,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-28 20:01:45,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:01:45,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:01:45,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:01:45,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:01:45,907 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:45,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 20:01:45,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:01:45,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 20:01:45,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 20:01:45,907 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:45,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-28 20:01:45,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:45,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:45,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:45,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:01:45,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-28 20:01:45,911 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:45,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:45,911 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:45,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:45,911 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:45,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:45,919 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:01:45,919 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:01:45,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:01:45,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:01:45,919 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:01:45,919 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 20:01:45,919 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:45,919 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-09-28 20:01:45,919 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-28 20:01:45,925 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:45,919 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:01:45,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:01:45,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:01:45,919 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:01:45,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:01:45,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:01:45,925 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:45,925 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-28 20:01:45,925 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-28 20:01:45,925 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-28 20:01:45,925 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-28 20:01:45,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:01:45,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:01:45,925 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:01:45,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:01:45,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:01:45,925 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:01:45,926 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 20:01:45,926 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:01:45,926 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:01:45,926 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 20:01:45,926 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 20:01:45,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:01:45,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:01:45,927 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230928c4117cad5e7f4c3cba6506fe87648321, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230928c680a41c4245428790b0b8ec3861f2f9] mob files 2023-09-28 20:01:45,927 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230928c4117cad5e7f4c3cba6506fe87648321 2023-09-28 20:01:45,927 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230928c680a41c4245428790b0b8ec3861f2f9 2023-09-28 20:01:45,936 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-09-28 20:01:45,936 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-28 20:01:45,958 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-28 20:01:45,959 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-28 20:01:45,959 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-28 20:01:45,959 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-28 20:01:45,960 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695931305770Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695931305935 (+165 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1695931305936 (+1 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1695931305936Writing data manifest for snaptb0-testConsecutiveExports at 1695931305940 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1695931305951 (+11 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695931305959 (+8 ms) 2023-09-28 20:01:45,962 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-28 20:01:45,964 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 191 msec 2023-09-28 20:01:46,074 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 20:01:46,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-28 20:01:46,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-28 20:01:46,075 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/local-export-1695931306075 2023-09-28 20:01:46,075 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/local-export-1695931306075, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/local-export-1695931306075, srcFsUri=hdfs://localhost:43143, srcDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff 2023-09-28 20:01:46,098 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43143, inputRoot=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff 2023-09-28 20:01:46,099 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@1107e029, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/local-export-1695931306075, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/local-export-1695931306075/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-28 20:01:46,099 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43143, inputRoot=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff, snapshotDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-28 20:01:46,107 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/local-export-1695931306075/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-28 20:01:46,120 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-28 20:01:46,121 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-28 20:01:46,121 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-28 20:01:46,121 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-28 20:01:47,002 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/hadoop-964572218566385660.jar 2023-09-28 20:01:47,002 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-28 20:01:47,002 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-28 20:01:47,069 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/hadoop-1524229881359985011.jar 2023-09-28 20:01:47,070 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-28 20:01:47,070 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-28 20:01:47,071 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-28 20:01:47,071 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-28 20:01:47,071 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-28 20:01:47,072 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-28 20:01:47,072 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-28 20:01:47,072 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-28 20:01:47,073 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-28 20:01:47,073 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-28 20:01:47,073 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-28 20:01:47,074 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-28 20:01:47,074 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-28 20:01:47,075 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-28 20:01:47,075 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-28 20:01:47,075 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-28 20:01:47,076 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 20:01:47,076 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 20:01:47,077 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 20:01:47,077 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 20:01:47,077 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 20:01:47,078 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 20:01:47,078 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 20:01:47,467 WARN [Listener at jenkins-hbase4.apache.org/41509] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-28 20:01:47,469 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-28 20:01:47,471 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-28 20:01:48,591 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 20:01:48,591 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 20:01:48,595 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695931268848_0002_000001 (auth:SIMPLE) 2023-09-28 20:01:49,504 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695931268848_0003_000001 (auth:SIMPLE) 2023-09-28 20:01:50,022 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-28 20:01:53,438 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695931268848_0003_000001 (auth:SIMPLE) 2023-09-28 20:01:55,670 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695931268848_0003_000001 (auth:SIMPLE) 2023-09-28 20:01:58,061 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695931268848_0003_000001 (auth:SIMPLE) 2023-09-28 20:01:59,656 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-28 20:01:59,657 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-28 20:01:59,661 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-28 20:01:59,662 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-28 20:01:59,662 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-28 20:01:59,662 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_394157282_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-28 20:01:59,665 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(367): hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-28 20:01:59,665 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(367): hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-28 20:01:59,665 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@29e52fa4 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/local-export-1695931306075/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/local-export-1695931306075/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-28 20:01:59,666 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/local-export-1695931306075/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-28 20:01:59,666 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/local-export-1695931306075/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-28 20:01:59,667 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/local-export-1695931306075, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/local-export-1695931306075, srcFsUri=hdfs://localhost:43143, srcDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff 2023-09-28 20:01:59,690 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43143, inputRoot=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff 2023-09-28 20:01:59,690 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@6fc57900, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/local-export-1695931306075, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/local-export-1695931306075/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-28 20:01:59,690 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43143, inputRoot=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff, snapshotDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-28 20:01:59,702 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/local-export-1695931306075/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-28 20:01:59,715 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-28 20:01:59,715 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-28 20:01:59,715 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-28 20:01:59,716 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-28 20:02:00,588 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/hadoop-8779733818611469704.jar 2023-09-28 20:02:00,588 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-28 20:02:00,588 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-28 20:02:00,655 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/hadoop-3345797036662776901.jar 2023-09-28 20:02:00,655 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-28 20:02:00,656 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-28 20:02:00,656 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-28 20:02:00,656 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-28 20:02:00,657 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-28 20:02:00,657 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-28 20:02:00,657 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-28 20:02:00,658 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-28 20:02:00,658 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-28 20:02:00,659 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-28 20:02:00,659 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-28 20:02:00,660 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-28 20:02:00,660 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-28 20:02:00,660 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-28 20:02:00,660 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-28 20:02:00,661 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-28 20:02:00,662 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 20:02:00,662 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 20:02:00,663 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 20:02:00,663 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 20:02:00,663 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 20:02:00,663 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 20:02:00,664 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 20:02:01,057 WARN [Listener at jenkins-hbase4.apache.org/41509] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-28 20:02:01,060 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-28 20:02:01,062 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-28 20:02:04,234 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 20:02:04,234 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 20:02:04,238 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695931268848_0003_000001 (auth:SIMPLE) 2023-09-28 20:02:04,606 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695931268848_0004_000001 (auth:SIMPLE) 2023-09-28 20:02:08,440 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695931268848_0004_000001 (auth:SIMPLE) 2023-09-28 20:02:10,659 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695931268848_0004_000001 (auth:SIMPLE) 2023-09-28 20:02:12,968 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695931268848_0004_000001 (auth:SIMPLE) 2023-09-28 20:02:14,224 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-28 20:02:14,224 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-28 20:02:14,228 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-28 20:02:14,228 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-28 20:02:14,228 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-28 20:02:14,228 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_394157282_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-28 20:02:14,232 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(367): hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-28 20:02:14,232 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(367): hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-28 20:02:14,232 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@29e52fa4 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/local-export-1695931306075/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/local-export-1695931306075/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-28 20:02:14,233 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/local-export-1695931306075/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-28 20:02:14,233 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/local-export-1695931306075/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-28 20:02:14,247 INFO [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-09-28 20:02:14,248 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-09-28 20:02:14,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-09-28 20:02:14,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-28 20:02:14,252 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695931334252"}]},"ts":"1695931334252"} 2023-09-28 20:02:14,254 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-09-28 20:02:14,255 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-09-28 20:02:14,256 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=180277fcc588175ceffd55fdec8db473, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ff8c510f9367a5ab781d765159352ac4, UNASSIGN}] 2023-09-28 20:02:14,258 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=180277fcc588175ceffd55fdec8db473, UNASSIGN 2023-09-28 20:02:14,258 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ff8c510f9367a5ab781d765159352ac4, UNASSIGN 2023-09-28 20:02:14,259 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=180277fcc588175ceffd55fdec8db473, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:14,259 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=ff8c510f9367a5ab781d765159352ac4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:14,259 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695931304740.180277fcc588175ceffd55fdec8db473.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695931334259"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695931334259"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695931334259"}]},"ts":"1695931334259"} 2023-09-28 20:02:14,259 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695931304740.ff8c510f9367a5ab781d765159352ac4.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695931334259"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695931334259"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695931334259"}]},"ts":"1695931334259"} 2023-09-28 20:02:14,260 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 180277fcc588175ceffd55fdec8db473, server=jenkins-hbase4.apache.org,46795,1695931262192}] 2023-09-28 20:02:14,261 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure ff8c510f9367a5ab781d765159352ac4, server=jenkins-hbase4.apache.org,38759,1695931262240}] 2023-09-28 20:02:14,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-28 20:02:14,413 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 180277fcc588175ceffd55fdec8db473 2023-09-28 20:02:14,413 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 180277fcc588175ceffd55fdec8db473, disabling compactions & flushes 2023-09-28 20:02:14,413 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695931304740.180277fcc588175ceffd55fdec8db473. 2023-09-28 20:02:14,413 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695931304740.180277fcc588175ceffd55fdec8db473. 2023-09-28 20:02:14,413 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695931304740.180277fcc588175ceffd55fdec8db473. after waiting 0 ms 2023-09-28 20:02:14,413 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695931304740.180277fcc588175ceffd55fdec8db473. 2023-09-28 20:02:14,414 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ff8c510f9367a5ab781d765159352ac4 2023-09-28 20:02:14,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ff8c510f9367a5ab781d765159352ac4, disabling compactions & flushes 2023-09-28 20:02:14,417 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695931304740.ff8c510f9367a5ab781d765159352ac4. 2023-09-28 20:02:14,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695931304740.ff8c510f9367a5ab781d765159352ac4. 2023-09-28 20:02:14,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695931304740.ff8c510f9367a5ab781d765159352ac4. after waiting 0 ms 2023-09-28 20:02:14,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695931304740.ff8c510f9367a5ab781d765159352ac4. 2023-09-28 20:02:14,433 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testConsecutiveExports/180277fcc588175ceffd55fdec8db473/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-28 20:02:14,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testConsecutiveExports/ff8c510f9367a5ab781d765159352ac4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-28 20:02:14,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 20:02:14,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 20:02:14,435 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695931304740.180277fcc588175ceffd55fdec8db473. 2023-09-28 20:02:14,436 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695931304740.ff8c510f9367a5ab781d765159352ac4. 2023-09-28 20:02:14,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 180277fcc588175ceffd55fdec8db473: 2023-09-28 20:02:14,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ff8c510f9367a5ab781d765159352ac4: 2023-09-28 20:02:14,438 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 180277fcc588175ceffd55fdec8db473 2023-09-28 20:02:14,438 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=180277fcc588175ceffd55fdec8db473, regionState=CLOSED 2023-09-28 20:02:14,438 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ff8c510f9367a5ab781d765159352ac4 2023-09-28 20:02:14,438 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695931304740.180277fcc588175ceffd55fdec8db473.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695931334438"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695931334438"}]},"ts":"1695931334438"} 2023-09-28 20:02:14,439 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=ff8c510f9367a5ab781d765159352ac4, regionState=CLOSED 2023-09-28 20:02:14,439 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695931304740.ff8c510f9367a5ab781d765159352ac4.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695931334439"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695931334439"}]},"ts":"1695931334439"} 2023-09-28 20:02:14,442 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=52 2023-09-28 20:02:14,442 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 180277fcc588175ceffd55fdec8db473, server=jenkins-hbase4.apache.org,46795,1695931262192 in 180 msec 2023-09-28 20:02:14,442 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=53 2023-09-28 20:02:14,442 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure ff8c510f9367a5ab781d765159352ac4, server=jenkins-hbase4.apache.org,38759,1695931262240 in 180 msec 2023-09-28 20:02:14,443 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=180277fcc588175ceffd55fdec8db473, UNASSIGN in 186 msec 2023-09-28 20:02:14,444 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-09-28 20:02:14,444 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ff8c510f9367a5ab781d765159352ac4, UNASSIGN in 186 msec 2023-09-28 20:02:14,444 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695931334444"}]},"ts":"1695931334444"} 2023-09-28 20:02:14,446 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-09-28 20:02:14,448 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-09-28 20:02:14,449 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 200 msec 2023-09-28 20:02:14,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-28 20:02:14,555 INFO [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-09-28 20:02:14,555 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-09-28 20:02:14,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-28 20:02:14,559 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-28 20:02:14,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-09-28 20:02:14,560 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-28 20:02:14,562 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33091] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-09-28 20:02:14,565 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testConsecutiveExports/180277fcc588175ceffd55fdec8db473 2023-09-28 20:02:14,565 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testConsecutiveExports/ff8c510f9367a5ab781d765159352ac4 2023-09-28 20:02:14,566 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-28 20:02:14,566 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-28 20:02:14,566 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-28 20:02:14,566 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-28 20:02:14,567 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-28 20:02:14,567 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-28 20:02:14,567 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-28 20:02:14,567 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-28 20:02:14,568 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-28 20:02:14,568 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-28 20:02:14,568 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-28 20:02:14,568 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 20:02:14,568 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 20:02:14,568 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-28 20:02:14,568 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testConsecutiveExports/ff8c510f9367a5ab781d765159352ac4/cf, FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testConsecutiveExports/ff8c510f9367a5ab781d765159352ac4/recovered.edits] 2023-09-28 20:02:14,568 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testConsecutiveExports/180277fcc588175ceffd55fdec8db473/cf, FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testConsecutiveExports/180277fcc588175ceffd55fdec8db473/recovered.edits] 2023-09-28 20:02:14,568 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 20:02:14,568 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 20:02:14,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-28 20:02:14,572 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testConsecutiveExports/ff8c510f9367a5ab781d765159352ac4/cf/6cf5d1f3c46847c4a1e8e8797cfad735 to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/archive/data/default/testtb-testConsecutiveExports/ff8c510f9367a5ab781d765159352ac4/cf/6cf5d1f3c46847c4a1e8e8797cfad735 2023-09-28 20:02:14,573 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testConsecutiveExports/180277fcc588175ceffd55fdec8db473/cf/d8fca77498a54bafaaa69de49db33341 to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/archive/data/default/testtb-testConsecutiveExports/180277fcc588175ceffd55fdec8db473/cf/d8fca77498a54bafaaa69de49db33341 2023-09-28 20:02:14,576 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testConsecutiveExports/ff8c510f9367a5ab781d765159352ac4/recovered.edits/9.seqid to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/archive/data/default/testtb-testConsecutiveExports/ff8c510f9367a5ab781d765159352ac4/recovered.edits/9.seqid 2023-09-28 20:02:14,576 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testConsecutiveExports/180277fcc588175ceffd55fdec8db473/recovered.edits/9.seqid to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/archive/data/default/testtb-testConsecutiveExports/180277fcc588175ceffd55fdec8db473/recovered.edits/9.seqid 2023-09-28 20:02:14,577 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testConsecutiveExports/ff8c510f9367a5ab781d765159352ac4 2023-09-28 20:02:14,577 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testConsecutiveExports/180277fcc588175ceffd55fdec8db473 2023-09-28 20:02:14,577 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-28 20:02:14,577 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-28 20:02:14,578 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-09-28 20:02:14,581 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230928c4117cad5e7f4c3cba6506fe87648321 to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230928c4117cad5e7f4c3cba6506fe87648321 2023-09-28 20:02:14,582 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230928c680a41c4245428790b0b8ec3861f2f9 to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230928c680a41c4245428790b0b8ec3861f2f9 2023-09-28 20:02:14,583 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-28 20:02:14,585 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-28 20:02:14,588 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-09-28 20:02:14,590 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-09-28 20:02:14,592 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-28 20:02:14,592 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-09-28 20:02:14,592 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1695931304740.180277fcc588175ceffd55fdec8db473.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695931334592"}]},"ts":"9223372036854775807"} 2023-09-28 20:02:14,592 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1695931304740.ff8c510f9367a5ab781d765159352ac4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695931334592"}]},"ts":"9223372036854775807"} 2023-09-28 20:02:14,594 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-28 20:02:14,594 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 180277fcc588175ceffd55fdec8db473, NAME => 'testtb-testConsecutiveExports,,1695931304740.180277fcc588175ceffd55fdec8db473.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => ff8c510f9367a5ab781d765159352ac4, NAME => 'testtb-testConsecutiveExports,1,1695931304740.ff8c510f9367a5ab781d765159352ac4.', STARTKEY => '1', ENDKEY => ''}] 2023-09-28 20:02:14,594 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-09-28 20:02:14,594 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695931334594"}]},"ts":"9223372036854775807"} 2023-09-28 20:02:14,595 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-09-28 20:02:14,597 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-28 20:02:14,599 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 41 msec 2023-09-28 20:02:14,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-28 20:02:14,670 INFO [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-09-28 20:02:14,678 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-09-28 20:02:14,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-09-28 20:02:14,682 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-09-28 20:02:14,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-09-28 20:02:14,711 INFO [Listener at jenkins-hbase4.apache.org/41509] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=749 (was 767), OpenFileDescriptor=900 (was 925), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=206 (was 285), ProcessCount=168 (was 168), AvailableMemoryMB=4604 (was 4715) 2023-09-28 20:02:14,711 WARN [Listener at jenkins-hbase4.apache.org/41509] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-09-28 20:02:14,731 INFO [Listener at jenkins-hbase4.apache.org/41509] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=749, OpenFileDescriptor=900, MaxFileDescriptor=60000, SystemLoadAverage=206, ProcessCount=168, AvailableMemoryMB=4603 2023-09-28 20:02:14,731 WARN [Listener at jenkins-hbase4.apache.org/41509] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-09-28 20:02:14,733 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-28 20:02:14,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:14,737 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-09-28 20:02:14,737 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-09-28 20:02:14,738 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-28 20:02:14,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-28 20:02:14,741 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/bbd9ba775b880b2737e4a5caf8e27a3d 2023-09-28 20:02:14,741 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a4219038cfe3706074acd9e496dcc3b4 2023-09-28 20:02:14,741 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/bbd9ba775b880b2737e4a5caf8e27a3d empty. 2023-09-28 20:02:14,741 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a4219038cfe3706074acd9e496dcc3b4 empty. 2023-09-28 20:02:14,742 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/bbd9ba775b880b2737e4a5caf8e27a3d 2023-09-28 20:02:14,742 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a4219038cfe3706074acd9e496dcc3b4 2023-09-28 20:02:14,742 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-28 20:02:14,752 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-09-28 20:02:14,753 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => a4219038cfe3706074acd9e496dcc3b4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695931334733.a4219038cfe3706074acd9e496dcc3b4.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp 2023-09-28 20:02:14,753 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => bbd9ba775b880b2737e4a5caf8e27a3d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695931334733.bbd9ba775b880b2737e4a5caf8e27a3d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp 2023-09-28 20:02:14,769 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695931334733.bbd9ba775b880b2737e4a5caf8e27a3d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 20:02:14,769 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing bbd9ba775b880b2737e4a5caf8e27a3d, disabling compactions & flushes 2023-09-28 20:02:14,770 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695931334733.bbd9ba775b880b2737e4a5caf8e27a3d. 2023-09-28 20:02:14,770 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695931334733.bbd9ba775b880b2737e4a5caf8e27a3d. 2023-09-28 20:02:14,770 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695931334733.bbd9ba775b880b2737e4a5caf8e27a3d. after waiting 0 ms 2023-09-28 20:02:14,770 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695931334733.bbd9ba775b880b2737e4a5caf8e27a3d. 2023-09-28 20:02:14,770 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695931334733.bbd9ba775b880b2737e4a5caf8e27a3d. 2023-09-28 20:02:14,770 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for bbd9ba775b880b2737e4a5caf8e27a3d: 2023-09-28 20:02:14,772 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695931334733.a4219038cfe3706074acd9e496dcc3b4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 20:02:14,772 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing a4219038cfe3706074acd9e496dcc3b4, disabling compactions & flushes 2023-09-28 20:02:14,772 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695931334733.a4219038cfe3706074acd9e496dcc3b4. 2023-09-28 20:02:14,772 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695931334733.a4219038cfe3706074acd9e496dcc3b4. 2023-09-28 20:02:14,772 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695931334733.a4219038cfe3706074acd9e496dcc3b4. after waiting 0 ms 2023-09-28 20:02:14,772 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695931334733.a4219038cfe3706074acd9e496dcc3b4. 2023-09-28 20:02:14,772 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695931334733.a4219038cfe3706074acd9e496dcc3b4. 2023-09-28 20:02:14,772 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for a4219038cfe3706074acd9e496dcc3b4: 2023-09-28 20:02:14,774 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-09-28 20:02:14,775 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695931334733.bbd9ba775b880b2737e4a5caf8e27a3d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695931334775"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695931334775"}]},"ts":"1695931334775"} 2023-09-28 20:02:14,776 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695931334733.a4219038cfe3706074acd9e496dcc3b4.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695931334775"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695931334775"}]},"ts":"1695931334775"} 2023-09-28 20:02:14,782 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-28 20:02:14,783 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-28 20:02:14,783 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695931334783"}]},"ts":"1695931334783"} 2023-09-28 20:02:14,785 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-09-28 20:02:14,789 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-28 20:02:14,790 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-28 20:02:14,790 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-28 20:02:14,790 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-28 20:02:14,790 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-28 20:02:14,791 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=bbd9ba775b880b2737e4a5caf8e27a3d, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a4219038cfe3706074acd9e496dcc3b4, ASSIGN}] 2023-09-28 20:02:14,793 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a4219038cfe3706074acd9e496dcc3b4, ASSIGN 2023-09-28 20:02:14,793 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=bbd9ba775b880b2737e4a5caf8e27a3d, ASSIGN 2023-09-28 20:02:14,794 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a4219038cfe3706074acd9e496dcc3b4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33091,1695931262281; forceNewPlan=false, retain=false 2023-09-28 20:02:14,794 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=bbd9ba775b880b2737e4a5caf8e27a3d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46795,1695931262192; forceNewPlan=false, retain=false 2023-09-28 20:02:14,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-28 20:02:14,944 INFO [jenkins-hbase4:35173] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-28 20:02:14,947 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=bbd9ba775b880b2737e4a5caf8e27a3d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:14,947 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=a4219038cfe3706074acd9e496dcc3b4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:14,947 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695931334733.bbd9ba775b880b2737e4a5caf8e27a3d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695931334947"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695931334947"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695931334947"}]},"ts":"1695931334947"} 2023-09-28 20:02:14,947 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695931334733.a4219038cfe3706074acd9e496dcc3b4.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695931334947"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695931334947"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695931334947"}]},"ts":"1695931334947"} 2023-09-28 20:02:14,949 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure bbd9ba775b880b2737e4a5caf8e27a3d, server=jenkins-hbase4.apache.org,46795,1695931262192}] 2023-09-28 20:02:14,950 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure a4219038cfe3706074acd9e496dcc3b4, server=jenkins-hbase4.apache.org,33091,1695931262281}] 2023-09-28 20:02:15,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-28 20:02:15,107 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1695931334733.bbd9ba775b880b2737e4a5caf8e27a3d. 2023-09-28 20:02:15,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bbd9ba775b880b2737e4a5caf8e27a3d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695931334733.bbd9ba775b880b2737e4a5caf8e27a3d.', STARTKEY => '', ENDKEY => '1'} 2023-09-28 20:02:15,107 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1695931334733.a4219038cfe3706074acd9e496dcc3b4. 2023-09-28 20:02:15,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a4219038cfe3706074acd9e496dcc3b4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695931334733.a4219038cfe3706074acd9e496dcc3b4.', STARTKEY => '1', ENDKEY => ''} 2023-09-28 20:02:15,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1695931334733.bbd9ba775b880b2737e4a5caf8e27a3d. service=AccessControlService 2023-09-28 20:02:15,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1695931334733.a4219038cfe3706074acd9e496dcc3b4. service=AccessControlService 2023-09-28 20:02:15,108 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 20:02:15,108 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 20:02:15,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion bbd9ba775b880b2737e4a5caf8e27a3d 2023-09-28 20:02:15,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion a4219038cfe3706074acd9e496dcc3b4 2023-09-28 20:02:15,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695931334733.bbd9ba775b880b2737e4a5caf8e27a3d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 20:02:15,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695931334733.a4219038cfe3706074acd9e496dcc3b4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 20:02:15,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bbd9ba775b880b2737e4a5caf8e27a3d 2023-09-28 20:02:15,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a4219038cfe3706074acd9e496dcc3b4 2023-09-28 20:02:15,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bbd9ba775b880b2737e4a5caf8e27a3d 2023-09-28 20:02:15,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a4219038cfe3706074acd9e496dcc3b4 2023-09-28 20:02:15,110 INFO [StoreOpener-a4219038cfe3706074acd9e496dcc3b4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a4219038cfe3706074acd9e496dcc3b4 2023-09-28 20:02:15,110 INFO [StoreOpener-bbd9ba775b880b2737e4a5caf8e27a3d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region bbd9ba775b880b2737e4a5caf8e27a3d 2023-09-28 20:02:15,111 DEBUG [StoreOpener-a4219038cfe3706074acd9e496dcc3b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion/a4219038cfe3706074acd9e496dcc3b4/cf 2023-09-28 20:02:15,111 DEBUG [StoreOpener-bbd9ba775b880b2737e4a5caf8e27a3d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion/bbd9ba775b880b2737e4a5caf8e27a3d/cf 2023-09-28 20:02:15,111 DEBUG [StoreOpener-bbd9ba775b880b2737e4a5caf8e27a3d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion/bbd9ba775b880b2737e4a5caf8e27a3d/cf 2023-09-28 20:02:15,111 DEBUG [StoreOpener-a4219038cfe3706074acd9e496dcc3b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion/a4219038cfe3706074acd9e496dcc3b4/cf 2023-09-28 20:02:15,113 INFO [StoreOpener-bbd9ba775b880b2737e4a5caf8e27a3d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bbd9ba775b880b2737e4a5caf8e27a3d columnFamilyName cf 2023-09-28 20:02:15,113 INFO [StoreOpener-a4219038cfe3706074acd9e496dcc3b4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a4219038cfe3706074acd9e496dcc3b4 columnFamilyName cf 2023-09-28 20:02:15,114 INFO [StoreOpener-bbd9ba775b880b2737e4a5caf8e27a3d-1] regionserver.HStore(310): Store=bbd9ba775b880b2737e4a5caf8e27a3d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 20:02:15,115 INFO [StoreOpener-a4219038cfe3706074acd9e496dcc3b4-1] regionserver.HStore(310): Store=a4219038cfe3706074acd9e496dcc3b4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 20:02:15,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion/bbd9ba775b880b2737e4a5caf8e27a3d 2023-09-28 20:02:15,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion/a4219038cfe3706074acd9e496dcc3b4 2023-09-28 20:02:15,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion/bbd9ba775b880b2737e4a5caf8e27a3d 2023-09-28 20:02:15,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion/a4219038cfe3706074acd9e496dcc3b4 2023-09-28 20:02:15,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bbd9ba775b880b2737e4a5caf8e27a3d 2023-09-28 20:02:15,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a4219038cfe3706074acd9e496dcc3b4 2023-09-28 20:02:15,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion/a4219038cfe3706074acd9e496dcc3b4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 20:02:15,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion/bbd9ba775b880b2737e4a5caf8e27a3d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 20:02:15,122 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bbd9ba775b880b2737e4a5caf8e27a3d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60139425, jitterRate=-0.10385273396968842}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 20:02:15,122 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a4219038cfe3706074acd9e496dcc3b4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69423468, jitterRate=0.03449028730392456}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 20:02:15,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bbd9ba775b880b2737e4a5caf8e27a3d: 2023-09-28 20:02:15,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a4219038cfe3706074acd9e496dcc3b4: 2023-09-28 20:02:15,123 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1695931334733.bbd9ba775b880b2737e4a5caf8e27a3d., pid=60, masterSystemTime=1695931335101 2023-09-28 20:02:15,123 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1695931334733.a4219038cfe3706074acd9e496dcc3b4., pid=61, masterSystemTime=1695931335101 2023-09-28 20:02:15,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1695931334733.a4219038cfe3706074acd9e496dcc3b4. 2023-09-28 20:02:15,125 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1695931334733.a4219038cfe3706074acd9e496dcc3b4. 2023-09-28 20:02:15,125 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=a4219038cfe3706074acd9e496dcc3b4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:15,126 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695931334733.a4219038cfe3706074acd9e496dcc3b4.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695931335125"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695931335125"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695931335125"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695931335125"}]},"ts":"1695931335125"} 2023-09-28 20:02:15,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1695931334733.bbd9ba775b880b2737e4a5caf8e27a3d. 2023-09-28 20:02:15,126 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1695931334733.bbd9ba775b880b2737e4a5caf8e27a3d. 2023-09-28 20:02:15,126 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=bbd9ba775b880b2737e4a5caf8e27a3d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:15,126 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695931334733.bbd9ba775b880b2737e4a5caf8e27a3d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695931335126"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695931335126"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695931335126"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695931335126"}]},"ts":"1695931335126"} 2023-09-28 20:02:15,130 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=59 2023-09-28 20:02:15,130 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure a4219038cfe3706074acd9e496dcc3b4, server=jenkins-hbase4.apache.org,33091,1695931262281 in 178 msec 2023-09-28 20:02:15,131 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=58 2023-09-28 20:02:15,131 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a4219038cfe3706074acd9e496dcc3b4, ASSIGN in 339 msec 2023-09-28 20:02:15,131 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure bbd9ba775b880b2737e4a5caf8e27a3d, server=jenkins-hbase4.apache.org,46795,1695931262192 in 180 msec 2023-09-28 20:02:15,133 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=58, resume processing ppid=57 2023-09-28 20:02:15,133 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=bbd9ba775b880b2737e4a5caf8e27a3d, ASSIGN in 341 msec 2023-09-28 20:02:15,133 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-28 20:02:15,133 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695931335133"}]},"ts":"1695931335133"} 2023-09-28 20:02:15,135 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-09-28 20:02:15,137 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-09-28 20:02:15,137 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-09-28 20:02:15,139 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33091] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-28 20:02:15,140 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 20:02:15,140 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 20:02:15,140 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 20:02:15,140 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 20:02:15,143 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-28 20:02:15,143 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-28 20:02:15,143 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-28 20:02:15,143 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-28 20:02:15,144 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 410 msec 2023-09-28 20:02:15,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-28 20:02:15,342 INFO [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-09-28 20:02:15,345 DEBUG [Listener at jenkins-hbase4.apache.org/41509] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,345 DEBUG [Listener at jenkins-hbase4.apache.org/41509] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695931334733.bbd9ba775b880b2737e4a5caf8e27a3d. 2023-09-28 20:02:15,347 INFO [Listener at jenkins-hbase4.apache.org/41509] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-28 20:02:15,360 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-28 20:02:15,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695931335360 (current time:1695931335360). 2023-09-28 20:02:15,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-28 20:02:15,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] zookeeper.ReadOnlyZKClient(139): Connect 0x525bf0af to 127.0.0.1:50329 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 20:02:15,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d9da7a2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 20:02:15,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 20:02:15,373 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34880, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 20:02:15,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x525bf0af to 127.0.0.1:50329 2023-09-28 20:02:15,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 20:02:15,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] zookeeper.ReadOnlyZKClient(139): Connect 0x2691aacb to 127.0.0.1:50329 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 20:02:15,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b42f83e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 20:02:15,382 DEBUG [hconnection-0x7bb2ea43-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 20:02:15,383 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34884, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 20:02:15,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2691aacb to 127.0.0.1:50329 2023-09-28 20:02:15,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 20:02:15,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-28 20:02:15,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-28 20:02:15,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-28 20:02:15,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-28 20:02:15,393 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-28 20:02:15,393 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695931935393 2023-09-28 20:02:15,393 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-28 20:02:15,395 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-28 20:02:15,396 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-28 20:02:15,396 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-28 20:02:15,396 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-28 20:02:15,397 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-09-28 20:02:15,398 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-28 20:02:15,398 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695931935398 2023-09-28 20:02:15,409 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,409 INFO [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-28 20:02:15,409 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 20:02:15,411 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-28 20:02:15,411 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-28 20:02:15,411 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,411 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,413 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:02:15,413 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:02:15,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:02:15,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:02:15,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:02:15,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:02:15,413 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:02:15,413 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:15,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:02:15,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:02:15,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,413 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:15,413 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:15,414 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,414 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,414 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,414 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:15,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-28 20:02:15,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-28 20:02:15,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-28 20:02:15,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,414 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-28 20:02:15,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,414 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-28 20:02:15,414 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-28 20:02:15,414 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-28 20:02:15,414 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,414 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,414 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-28 20:02:15,415 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-28 20:02:15,415 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 20:02:15,415 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 20:02:15,416 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-28 20:02:15,417 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-28 20:02:15,417 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-28 20:02:15,415 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,417 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38759,1695931262240' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-28 20:02:15,417 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-28 20:02:15,417 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 20:02:15,417 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-28 20:02:15,417 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46795,1695931262192' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-28 20:02:15,418 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-28 20:02:15,419 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-28 20:02:15,419 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33091,1695931262281' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-28 20:02:15,420 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,421 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,421 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:15,421 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:15,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:02:15,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:02:15,421 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,421 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,421 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 20:02:15,421 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 20:02:15,421 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:15,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:02:15,422 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,422 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 20:02:15,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:02:15,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:15,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:15,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:15,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:02:15,423 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46795,1695931262192' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-28 20:02:15,423 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b06d5b1[Count = 1] remaining members to acquire global barrier 2023-09-28 20:02:15,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:15,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:02:15,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:02:15,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:02:15,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:02:15,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:15,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:15,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:15,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:02:15,425 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33091,1695931262281' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-28 20:02:15,425 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b06d5b1[Count = 0] remaining members to acquire global barrier 2023-09-28 20:02:15,425 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-28 20:02:15,425 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,427 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,427 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,428 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,428 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:15,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,428 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-28 20:02:15,428 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-28 20:02:15,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,428 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-28 20:02:15,428 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 20:02:15,428 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 20:02:15,428 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-28 20:02:15,428 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695931334733.a4219038cfe3706074acd9e496dcc3b4. 2023-09-28 20:02:15,428 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,38759,1695931262240' in zk 2023-09-28 20:02:15,428 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695931334733.a4219038cfe3706074acd9e496dcc3b4. started... 2023-09-28 20:02:15,428 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 20:02:15,429 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 20:02:15,428 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695931334733.bbd9ba775b880b2737e4a5caf8e27a3d. 2023-09-28 20:02:15,428 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:15,429 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-28 20:02:15,429 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695931334733.bbd9ba775b880b2737e4a5caf8e27a3d. started... 2023-09-28 20:02:15,429 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bbd9ba775b880b2737e4a5caf8e27a3d: 2023-09-28 20:02:15,429 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695931334733.bbd9ba775b880b2737e4a5caf8e27a3d.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,429 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 20:02:15,429 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-28 20:02:15,431 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a4219038cfe3706074acd9e496dcc3b4: 2023-09-28 20:02:15,432 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695931334733.a4219038cfe3706074acd9e496dcc3b4.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,432 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 20:02:15,432 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-28 20:02:15,438 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-28 20:02:15,438 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 20:02:15,438 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-28 20:02:15,440 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695931334733.bbd9ba775b880b2737e4a5caf8e27a3d. completed. 2023-09-28 20:02:15,440 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695931334733.bbd9ba775b880b2737e4a5caf8e27a3d. 2023-09-28 20:02:15,441 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 20:02:15,441 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 20:02:15,441 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:15,441 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-28 20:02:15,441 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,46795,1695931262192' in zk 2023-09-28 20:02:15,441 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695931334733.a4219038cfe3706074acd9e496dcc3b4. completed. 2023-09-28 20:02:15,441 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695931334733.a4219038cfe3706074acd9e496dcc3b4. 2023-09-28 20:02:15,441 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 20:02:15,442 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 20:02:15,442 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:15,442 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-28 20:02:15,442 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,33091,1695931262281' in zk 2023-09-28 20:02:15,443 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-28 20:02:15,443 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 20:02:15,443 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-28 20:02:15,443 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:15,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:15,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:02:15,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:02:15,444 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:15,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:02:15,444 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-28 20:02:15,444 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 20:02:15,444 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-28 20:02:15,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:02:15,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:15,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:15,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:15,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:02:15,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:15,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:15,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:15,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,46795,1695931262192': 2023-09-28 20:02:15,449 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46795,1695931262192' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-28 20:02:15,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:15,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:02:15,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:02:15,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:02:15,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:02:15,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:15,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:15,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:15,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:02:15,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:15,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:15,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:15,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,33091,1695931262281': 2023-09-28 20:02:15,452 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33091,1695931262281' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-28 20:02:15,452 INFO [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-28 20:02:15,452 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-28 20:02:15,452 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-28 20:02:15,452 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,452 INFO [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-28 20:02:15,459 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,459 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,459 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:02:15,459 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,459 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,459 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:02:15,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,459 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:02:15,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,459 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:15,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:02:15,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:02:15,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:02:15,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:02:15,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:02:15,460 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:15,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:02:15,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:02:15,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:02:15,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:02:15,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,460 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:15,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:02:15,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:15,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:15,462 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:15,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:15,463 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:15,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:02:15,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,463 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:15,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:15,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:15,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:15,466 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:02:15,466 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:02:15,466 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:02:15,466 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:15,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:02:15,467 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 20:02:15,466 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:02:15,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:02:15,466 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:02:15,468 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:15,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:02:15,467 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,467 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:02:15,468 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:02:15,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:02:15,469 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:02:15,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:02:15,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:02:15,468 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:15,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:02:15,469 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:02:15,469 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,469 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-28 20:02:15,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:02:15,469 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:15,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:02:15,470 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,470 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:15,470 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:15,470 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,470 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,470 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-28 20:02:15,479 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,479 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,496 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 20:02:15,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-28 20:02:15,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-28 20:02:15,498 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-28 20:02:15,499 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,499 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-28 20:02:15,500 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,500 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,500 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695931335394Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695931335479 (+85 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695931335479Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695931335479Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695931335482 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695931335493 (+11 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695931335499 (+6 ms) 2023-09-28 20:02:15,502 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-28 20:02:15,504 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 108 msec 2023-09-28 20:02:15,698 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 20:02:15,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-28 20:02:15,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-28 20:02:15,701 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46795] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1695931334733.bbd9ba775b880b2737e4a5caf8e27a3d. with WAL disabled. Data may be lost in the event of a crash. 2023-09-28 20:02:15,702 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1695931334733.a4219038cfe3706074acd9e496dcc3b4. with WAL disabled. Data may be lost in the event of a crash. 2023-09-28 20:02:15,706 DEBUG [Listener at jenkins-hbase4.apache.org/41509] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,706 DEBUG [Listener at jenkins-hbase4.apache.org/41509] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695931334733.bbd9ba775b880b2737e4a5caf8e27a3d. 2023-09-28 20:02:15,706 INFO [Listener at jenkins-hbase4.apache.org/41509] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-28 20:02:15,716 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-28 20:02:15,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695931335717 (current time:1695931335717). 2023-09-28 20:02:15,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-28 20:02:15,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] zookeeper.ReadOnlyZKClient(139): Connect 0x73399742 to 127.0.0.1:50329 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 20:02:15,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4a0d11d7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 20:02:15,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 20:02:15,728 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34894, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 20:02:15,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x73399742 to 127.0.0.1:50329 2023-09-28 20:02:15,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 20:02:15,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] zookeeper.ReadOnlyZKClient(139): Connect 0x0a88ed51 to 127.0.0.1:50329 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 20:02:15,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@35b4f8c5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 20:02:15,737 DEBUG [hconnection-0x1715d40d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 20:02:15,740 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34900, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 20:02:15,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a88ed51 to 127.0.0.1:50329 2023-09-28 20:02:15,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 20:02:15,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-28 20:02:15,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-28 20:02:15,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-28 20:02:15,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-28 20:02:15,749 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-28 20:02:15,750 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695931935750 2023-09-28 20:02:15,750 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-28 20:02:15,752 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-28 20:02:15,752 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-28 20:02:15,753 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-28 20:02:15,753 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-28 20:02:15,754 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-09-28 20:02:15,755 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-28 20:02:15,755 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695931935755 2023-09-28 20:02:15,765 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,766 INFO [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-28 20:02:15,766 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 20:02:15,767 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-28 20:02:15,767 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-28 20:02:15,768 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,768 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,769 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:02:15,769 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:02:15,769 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:15,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:02:15,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:02:15,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:02:15,769 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:02:15,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:02:15,769 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:15,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:02:15,769 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:15,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:02:15,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,770 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:15,770 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-28 20:02:15,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,770 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,770 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,770 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-28 20:02:15,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-28 20:02:15,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-28 20:02:15,771 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-28 20:02:15,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,771 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-28 20:02:15,771 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-28 20:02:15,771 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,771 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-28 20:02:15,771 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,771 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 20:02:15,771 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,772 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-28 20:02:15,772 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-28 20:02:15,773 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 20:02:15,771 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-28 20:02:15,774 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-28 20:02:15,774 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-28 20:02:15,772 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-28 20:02:15,774 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38759,1695931262240' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-28 20:02:15,774 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 20:02:15,774 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46795,1695931262192' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-28 20:02:15,775 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-28 20:02:15,775 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-28 20:02:15,775 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33091,1695931262281' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-28 20:02:15,776 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:15,777 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,777 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:15,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:02:15,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:02:15,779 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,779 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,779 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,779 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 20:02:15,779 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 20:02:15,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:02:15,779 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,779 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 20:02:15,779 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:15,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:02:15,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:15,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:15,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:15,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:02:15,781 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46795,1695931262192' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-28 20:02:15,781 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@64094558[Count = 1] remaining members to acquire global barrier 2023-09-28 20:02:15,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:15,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:02:15,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:02:15,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:02:15,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:02:15,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:15,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:15,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:15,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:02:15,783 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33091,1695931262281' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-28 20:02:15,783 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@64094558[Count = 0] remaining members to acquire global barrier 2023-09-28 20:02:15,783 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-28 20:02:15,783 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,784 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,784 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,784 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,784 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:15,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,784 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-28 20:02:15,784 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-28 20:02:15,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,784 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-28 20:02:15,784 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-28 20:02:15,785 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:15,785 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 20:02:15,785 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 20:02:15,785 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695931334733.a4219038cfe3706074acd9e496dcc3b4. 2023-09-28 20:02:15,785 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-28 20:02:15,785 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695931334733.bbd9ba775b880b2737e4a5caf8e27a3d. 2023-09-28 20:02:15,784 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,38759,1695931262240' in zk 2023-09-28 20:02:15,785 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695931334733.bbd9ba775b880b2737e4a5caf8e27a3d. started... 2023-09-28 20:02:15,785 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695931334733.a4219038cfe3706074acd9e496dcc3b4. started... 2023-09-28 20:02:15,785 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 20:02:15,785 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 20:02:15,785 INFO [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] regionserver.HRegion(2745): Flushing bbd9ba775b880b2737e4a5caf8e27a3d 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-28 20:02:15,785 INFO [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a4219038cfe3706074acd9e496dcc3b4 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-28 20:02:15,786 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-28 20:02:15,786 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 20:02:15,786 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-28 20:02:15,805 INFO [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230928fb6cd2793d9c4ee1b566b45228bdd762 to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230928fb6cd2793d9c4ee1b566b45228bdd762 2023-09-28 20:02:15,806 INFO [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309282e2f227936bc4d83b4629efe361ce979 to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202309282e2f227936bc4d83b4629efe361ce979 2023-09-28 20:02:15,813 INFO [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion/bbd9ba775b880b2737e4a5caf8e27a3d/.tmp/cf/4159b4f4f5d14a6fa496848f4eb10df3 2023-09-28 20:02:15,813 INFO [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion/a4219038cfe3706074acd9e496dcc3b4/.tmp/cf/b82165483a4843afbfba0ae8d58354ed 2023-09-28 20:02:15,818 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion/bbd9ba775b880b2737e4a5caf8e27a3d/.tmp/cf/4159b4f4f5d14a6fa496848f4eb10df3 as hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion/bbd9ba775b880b2737e4a5caf8e27a3d/cf/4159b4f4f5d14a6fa496848f4eb10df3 2023-09-28 20:02:15,818 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion/a4219038cfe3706074acd9e496dcc3b4/.tmp/cf/b82165483a4843afbfba0ae8d58354ed as hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion/a4219038cfe3706074acd9e496dcc3b4/cf/b82165483a4843afbfba0ae8d58354ed 2023-09-28 20:02:15,823 INFO [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion/a4219038cfe3706074acd9e496dcc3b4/cf/b82165483a4843afbfba0ae8d58354ed, entries=46, sequenceid=6, filesize=13.3 K 2023-09-28 20:02:15,823 INFO [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion/bbd9ba775b880b2737e4a5caf8e27a3d/cf/4159b4f4f5d14a6fa496848f4eb10df3, entries=4, sequenceid=6, filesize=5.6 K 2023-09-28 20:02:15,824 INFO [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for a4219038cfe3706074acd9e496dcc3b4 in 39ms, sequenceid=6, compaction requested=false 2023-09-28 20:02:15,824 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-28 20:02:15,824 INFO [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for bbd9ba775b880b2737e4a5caf8e27a3d in 39ms, sequenceid=6, compaction requested=false 2023-09-28 20:02:15,824 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-28 20:02:15,828 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a4219038cfe3706074acd9e496dcc3b4: 2023-09-28 20:02:15,828 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bbd9ba775b880b2737e4a5caf8e27a3d: 2023-09-28 20:02:15,828 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695931334733.a4219038cfe3706074acd9e496dcc3b4.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,828 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695931334733.bbd9ba775b880b2737e4a5caf8e27a3d.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,828 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 20:02:15,828 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 20:02:15,828 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion/a4219038cfe3706074acd9e496dcc3b4/cf/b82165483a4843afbfba0ae8d58354ed] hfiles 2023-09-28 20:02:15,828 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion/bbd9ba775b880b2737e4a5caf8e27a3d/cf/4159b4f4f5d14a6fa496848f4eb10df3] hfiles 2023-09-28 20:02:15,828 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion/a4219038cfe3706074acd9e496dcc3b4/cf/b82165483a4843afbfba0ae8d58354ed for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,828 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion/bbd9ba775b880b2737e4a5caf8e27a3d/cf/4159b4f4f5d14a6fa496848f4eb10df3 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,839 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695931334733.a4219038cfe3706074acd9e496dcc3b4. completed. 2023-09-28 20:02:15,840 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695931334733.a4219038cfe3706074acd9e496dcc3b4. 2023-09-28 20:02:15,840 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 20:02:15,840 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 20:02:15,840 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:15,840 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-28 20:02:15,840 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,33091,1695931262281' in zk 2023-09-28 20:02:15,842 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-28 20:02:15,842 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:15,842 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 20:02:15,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:15,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:02:15,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:02:15,842 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-28 20:02:15,844 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695931334733.bbd9ba775b880b2737e4a5caf8e27a3d. completed. 2023-09-28 20:02:15,844 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695931334733.bbd9ba775b880b2737e4a5caf8e27a3d. 2023-09-28 20:02:15,844 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 20:02:15,844 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 20:02:15,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:02:15,844 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:15,844 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-28 20:02:15,844 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,46795,1695931262192' in zk 2023-09-28 20:02:15,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:02:15,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,847 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:15,847 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-28 20:02:15,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:15,847 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 20:02:15,847 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-28 20:02:15,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:15,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:15,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:02:15,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:15,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:15,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:15,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,33091,1695931262281': 2023-09-28 20:02:15,851 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33091,1695931262281' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-28 20:02:15,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:15,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:02:15,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:02:15,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:02:15,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:02:15,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:15,852 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 20:02:15,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:15,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:15,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:02:15,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-28 20:02:15,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-28 20:02:15,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,853 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-28 20:02:15,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:15,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:15,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:15,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,46795,1695931262192': 2023-09-28 20:02:15,855 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46795,1695931262192' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-28 20:02:15,855 INFO [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-28 20:02:15,855 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-28 20:02:15,855 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-28 20:02:15,855 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,855 INFO [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-28 20:02:15,860 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,860 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:02:15,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:02:15,860 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,860 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:02:15,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:02:15,860 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,860 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:15,860 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:02:15,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:02:15,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:02:15,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,860 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:02:15,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:02:15,861 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:15,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:02:15,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:02:15,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:02:15,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:02:15,861 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:15,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:15,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:15,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:15,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:02:15,863 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:15,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,863 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:15,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:15,863 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:15,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:15,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:15,866 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:02:15,866 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:02:15,866 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:15,866 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:02:15,866 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,866 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 20:02:15,866 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,866 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,868 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,868 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:15,868 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-28 20:02:15,868 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:15,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:02:15,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:02:15,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:02:15,866 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:02:15,866 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:02:15,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:02:15,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:02:15,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:02:15,868 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,868 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:02:15,869 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:15,869 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:02:15,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:02:15,869 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:15,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:02:15,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:02:15,869 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:15,869 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,869 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,869 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230928fb6cd2793d9c4ee1b566b45228bdd762, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202309282e2f227936bc4d83b4629efe361ce979] mob files 2023-09-28 20:02:15,869 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230928fb6cd2793d9c4ee1b566b45228bdd762 2023-09-28 20:02:15,869 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202309282e2f227936bc4d83b4629efe361ce979 2023-09-28 20:02:15,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:02:15,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:02:15,877 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,877 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,902 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,903 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-28 20:02:15,903 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,903 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:15,904 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695931335750Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695931335877 (+127 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695931335877Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1695931335877Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1695931335881 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695931335894 (+13 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695931335903 (+9 ms) 2023-09-28 20:02:15,906 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-28 20:02:15,908 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 155 msec 2023-09-28 20:02:16,053 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 20:02:16,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-28 20:02:16,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-28 20:02:16,087 DEBUG [Listener at jenkins-hbase4.apache.org/41509] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-28 20:02:16,093 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34910, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-28 20:02:16,095 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-28 20:02:16,095 DEBUG [Listener at jenkins-hbase4.apache.org/41509] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-28 20:02:16,098 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41038, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-28 20:02:16,098 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38759] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-28 20:02:16,099 DEBUG [Listener at jenkins-hbase4.apache.org/41509] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-28 20:02:16,105 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39848, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-28 20:02:16,106 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46795] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-28 20:02:16,108 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-28 20:02:16,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:16,111 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-09-28 20:02:16,111 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-09-28 20:02:16,112 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-28 20:02:16,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-28 20:02:16,114 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/14950f04288c511c3d378e0dc1bebaa5 2023-09-28 20:02:16,114 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/94338e40c9d34d323ac2b634d0630a8f 2023-09-28 20:02:16,115 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/14950f04288c511c3d378e0dc1bebaa5 empty. 2023-09-28 20:02:16,115 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/94338e40c9d34d323ac2b634d0630a8f empty. 2023-09-28 20:02:16,115 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/14950f04288c511c3d378e0dc1bebaa5 2023-09-28 20:02:16,115 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/94338e40c9d34d323ac2b634d0630a8f 2023-09-28 20:02:16,115 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-28 20:02:16,126 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-09-28 20:02:16,127 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 94338e40c9d34d323ac2b634d0630a8f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695931336108.94338e40c9d34d323ac2b634d0630a8f.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp 2023-09-28 20:02:16,127 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 14950f04288c511c3d378e0dc1bebaa5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695931336108.14950f04288c511c3d378e0dc1bebaa5.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp 2023-09-28 20:02:16,136 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695931336108.94338e40c9d34d323ac2b634d0630a8f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 20:02:16,136 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 94338e40c9d34d323ac2b634d0630a8f, disabling compactions & flushes 2023-09-28 20:02:16,136 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695931336108.94338e40c9d34d323ac2b634d0630a8f. 2023-09-28 20:02:16,136 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695931336108.94338e40c9d34d323ac2b634d0630a8f. 2023-09-28 20:02:16,136 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695931336108.94338e40c9d34d323ac2b634d0630a8f. after waiting 0 ms 2023-09-28 20:02:16,136 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695931336108.94338e40c9d34d323ac2b634d0630a8f. 2023-09-28 20:02:16,136 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695931336108.94338e40c9d34d323ac2b634d0630a8f. 2023-09-28 20:02:16,136 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 94338e40c9d34d323ac2b634d0630a8f: 2023-09-28 20:02:16,136 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695931336108.14950f04288c511c3d378e0dc1bebaa5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 20:02:16,136 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 14950f04288c511c3d378e0dc1bebaa5, disabling compactions & flushes 2023-09-28 20:02:16,136 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695931336108.14950f04288c511c3d378e0dc1bebaa5. 2023-09-28 20:02:16,136 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695931336108.14950f04288c511c3d378e0dc1bebaa5. 2023-09-28 20:02:16,136 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695931336108.14950f04288c511c3d378e0dc1bebaa5. after waiting 0 ms 2023-09-28 20:02:16,136 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695931336108.14950f04288c511c3d378e0dc1bebaa5. 2023-09-28 20:02:16,136 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695931336108.14950f04288c511c3d378e0dc1bebaa5. 2023-09-28 20:02:16,136 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 14950f04288c511c3d378e0dc1bebaa5: 2023-09-28 20:02:16,138 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-09-28 20:02:16,139 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695931336108.94338e40c9d34d323ac2b634d0630a8f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695931336139"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695931336139"}]},"ts":"1695931336139"} 2023-09-28 20:02:16,139 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695931336108.14950f04288c511c3d378e0dc1bebaa5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695931336139"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695931336139"}]},"ts":"1695931336139"} 2023-09-28 20:02:16,141 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-28 20:02:16,142 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-28 20:02:16,142 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695931336142"}]},"ts":"1695931336142"} 2023-09-28 20:02:16,144 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-09-28 20:02:16,148 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-28 20:02:16,149 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-28 20:02:16,149 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-28 20:02:16,149 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-28 20:02:16,149 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-28 20:02:16,149 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=14950f04288c511c3d378e0dc1bebaa5, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=94338e40c9d34d323ac2b634d0630a8f, ASSIGN}] 2023-09-28 20:02:16,152 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=14950f04288c511c3d378e0dc1bebaa5, ASSIGN 2023-09-28 20:02:16,152 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=94338e40c9d34d323ac2b634d0630a8f, ASSIGN 2023-09-28 20:02:16,153 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=94338e40c9d34d323ac2b634d0630a8f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46795,1695931262192; forceNewPlan=false, retain=false 2023-09-28 20:02:16,153 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=14950f04288c511c3d378e0dc1bebaa5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33091,1695931262281; forceNewPlan=false, retain=false 2023-09-28 20:02:16,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-28 20:02:16,303 INFO [jenkins-hbase4:35173] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-28 20:02:16,306 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=94338e40c9d34d323ac2b634d0630a8f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:16,306 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=14950f04288c511c3d378e0dc1bebaa5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:16,306 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695931336108.94338e40c9d34d323ac2b634d0630a8f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695931336306"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695931336306"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695931336306"}]},"ts":"1695931336306"} 2023-09-28 20:02:16,306 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695931336108.14950f04288c511c3d378e0dc1bebaa5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695931336306"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695931336306"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695931336306"}]},"ts":"1695931336306"} 2023-09-28 20:02:16,308 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 94338e40c9d34d323ac2b634d0630a8f, server=jenkins-hbase4.apache.org,46795,1695931262192}] 2023-09-28 20:02:16,309 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure 14950f04288c511c3d378e0dc1bebaa5, server=jenkins-hbase4.apache.org,33091,1695931262281}] 2023-09-28 20:02:16,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-28 20:02:16,463 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1695931336108.94338e40c9d34d323ac2b634d0630a8f. 2023-09-28 20:02:16,463 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695931336108.14950f04288c511c3d378e0dc1bebaa5. 2023-09-28 20:02:16,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 94338e40c9d34d323ac2b634d0630a8f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695931336108.94338e40c9d34d323ac2b634d0630a8f.', STARTKEY => '2', ENDKEY => ''} 2023-09-28 20:02:16,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 14950f04288c511c3d378e0dc1bebaa5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695931336108.14950f04288c511c3d378e0dc1bebaa5.', STARTKEY => '', ENDKEY => '2'} 2023-09-28 20:02:16,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695931336108.14950f04288c511c3d378e0dc1bebaa5. service=AccessControlService 2023-09-28 20:02:16,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1695931336108.94338e40c9d34d323ac2b634d0630a8f. service=AccessControlService 2023-09-28 20:02:16,464 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 20:02:16,464 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 20:02:16,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 14950f04288c511c3d378e0dc1bebaa5 2023-09-28 20:02:16,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 94338e40c9d34d323ac2b634d0630a8f 2023-09-28 20:02:16,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695931336108.14950f04288c511c3d378e0dc1bebaa5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 20:02:16,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695931336108.94338e40c9d34d323ac2b634d0630a8f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 20:02:16,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 14950f04288c511c3d378e0dc1bebaa5 2023-09-28 20:02:16,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 94338e40c9d34d323ac2b634d0630a8f 2023-09-28 20:02:16,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 14950f04288c511c3d378e0dc1bebaa5 2023-09-28 20:02:16,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 94338e40c9d34d323ac2b634d0630a8f 2023-09-28 20:02:16,465 INFO [StoreOpener-14950f04288c511c3d378e0dc1bebaa5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 14950f04288c511c3d378e0dc1bebaa5 2023-09-28 20:02:16,465 INFO [StoreOpener-94338e40c9d34d323ac2b634d0630a8f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 94338e40c9d34d323ac2b634d0630a8f 2023-09-28 20:02:16,467 DEBUG [StoreOpener-14950f04288c511c3d378e0dc1bebaa5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/14950f04288c511c3d378e0dc1bebaa5/cf 2023-09-28 20:02:16,467 DEBUG [StoreOpener-94338e40c9d34d323ac2b634d0630a8f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/94338e40c9d34d323ac2b634d0630a8f/cf 2023-09-28 20:02:16,467 DEBUG [StoreOpener-94338e40c9d34d323ac2b634d0630a8f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/94338e40c9d34d323ac2b634d0630a8f/cf 2023-09-28 20:02:16,467 DEBUG [StoreOpener-14950f04288c511c3d378e0dc1bebaa5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/14950f04288c511c3d378e0dc1bebaa5/cf 2023-09-28 20:02:16,467 INFO [StoreOpener-14950f04288c511c3d378e0dc1bebaa5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 14950f04288c511c3d378e0dc1bebaa5 columnFamilyName cf 2023-09-28 20:02:16,467 INFO [StoreOpener-94338e40c9d34d323ac2b634d0630a8f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 94338e40c9d34d323ac2b634d0630a8f columnFamilyName cf 2023-09-28 20:02:16,468 INFO [StoreOpener-14950f04288c511c3d378e0dc1bebaa5-1] regionserver.HStore(310): Store=14950f04288c511c3d378e0dc1bebaa5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 20:02:16,468 INFO [StoreOpener-94338e40c9d34d323ac2b634d0630a8f-1] regionserver.HStore(310): Store=94338e40c9d34d323ac2b634d0630a8f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 20:02:16,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/94338e40c9d34d323ac2b634d0630a8f 2023-09-28 20:02:16,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/14950f04288c511c3d378e0dc1bebaa5 2023-09-28 20:02:16,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/94338e40c9d34d323ac2b634d0630a8f 2023-09-28 20:02:16,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/14950f04288c511c3d378e0dc1bebaa5 2023-09-28 20:02:16,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 14950f04288c511c3d378e0dc1bebaa5 2023-09-28 20:02:16,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 94338e40c9d34d323ac2b634d0630a8f 2023-09-28 20:02:16,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/14950f04288c511c3d378e0dc1bebaa5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 20:02:16,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/94338e40c9d34d323ac2b634d0630a8f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 20:02:16,474 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 14950f04288c511c3d378e0dc1bebaa5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66190941, jitterRate=-0.013678118586540222}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 20:02:16,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 14950f04288c511c3d378e0dc1bebaa5: 2023-09-28 20:02:16,474 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 94338e40c9d34d323ac2b634d0630a8f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59727041, jitterRate=-0.10999773442745209}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 20:02:16,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 94338e40c9d34d323ac2b634d0630a8f: 2023-09-28 20:02:16,475 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695931336108.14950f04288c511c3d378e0dc1bebaa5., pid=70, masterSystemTime=1695931336460 2023-09-28 20:02:16,475 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695931336108.94338e40c9d34d323ac2b634d0630a8f., pid=69, masterSystemTime=1695931336460 2023-09-28 20:02:16,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695931336108.14950f04288c511c3d378e0dc1bebaa5. 2023-09-28 20:02:16,477 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695931336108.14950f04288c511c3d378e0dc1bebaa5. 2023-09-28 20:02:16,477 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=14950f04288c511c3d378e0dc1bebaa5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:16,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695931336108.94338e40c9d34d323ac2b634d0630a8f. 2023-09-28 20:02:16,477 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1695931336108.94338e40c9d34d323ac2b634d0630a8f. 2023-09-28 20:02:16,477 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695931336108.14950f04288c511c3d378e0dc1bebaa5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695931336477"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695931336477"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695931336477"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695931336477"}]},"ts":"1695931336477"} 2023-09-28 20:02:16,478 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=94338e40c9d34d323ac2b634d0630a8f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:16,478 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695931336108.94338e40c9d34d323ac2b634d0630a8f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695931336478"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695931336478"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695931336478"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695931336478"}]},"ts":"1695931336478"} 2023-09-28 20:02:16,481 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=67 2023-09-28 20:02:16,481 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure 14950f04288c511c3d378e0dc1bebaa5, server=jenkins-hbase4.apache.org,33091,1695931262281 in 170 msec 2023-09-28 20:02:16,481 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=68 2023-09-28 20:02:16,481 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 94338e40c9d34d323ac2b634d0630a8f, server=jenkins-hbase4.apache.org,46795,1695931262192 in 172 msec 2023-09-28 20:02:16,482 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=14950f04288c511c3d378e0dc1bebaa5, ASSIGN in 332 msec 2023-09-28 20:02:16,483 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=68, resume processing ppid=66 2023-09-28 20:02:16,483 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=94338e40c9d34d323ac2b634d0630a8f, ASSIGN in 332 msec 2023-09-28 20:02:16,484 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-28 20:02:16,484 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695931336484"}]},"ts":"1695931336484"} 2023-09-28 20:02:16,485 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-09-28 20:02:16,487 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-09-28 20:02:16,488 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-09-28 20:02:16,489 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33091] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-28 20:02:16,491 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 20:02:16,491 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 20:02:16,491 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 20:02:16,491 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 20:02:16,492 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-28 20:02:16,492 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-28 20:02:16,493 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-28 20:02:16,493 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-28 20:02:16,493 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-28 20:02:16,493 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-28 20:02:16,493 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-28 20:02:16,493 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-28 20:02:16,493 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 384 msec 2023-09-28 20:02:16,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-28 20:02:16,716 INFO [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-09-28 20:02:16,738 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 14950f04288c511c3d378e0dc1bebaa5, 94338e40c9d34d323ac2b634d0630a8f 2023-09-28 20:02:16,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[14950f04288c511c3d378e0dc1bebaa5, 94338e40c9d34d323ac2b634d0630a8f], force=true 2023-09-28 20:02:16,748 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[14950f04288c511c3d378e0dc1bebaa5, 94338e40c9d34d323ac2b634d0630a8f], force=true 2023-09-28 20:02:16,748 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[14950f04288c511c3d378e0dc1bebaa5, 94338e40c9d34d323ac2b634d0630a8f], force=true 2023-09-28 20:02:16,748 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[14950f04288c511c3d378e0dc1bebaa5, 94338e40c9d34d323ac2b634d0630a8f], force=true 2023-09-28 20:02:16,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-28 20:02:16,771 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=14950f04288c511c3d378e0dc1bebaa5, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=94338e40c9d34d323ac2b634d0630a8f, UNASSIGN}] 2023-09-28 20:02:16,773 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=14950f04288c511c3d378e0dc1bebaa5, UNASSIGN 2023-09-28 20:02:16,773 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=94338e40c9d34d323ac2b634d0630a8f, UNASSIGN 2023-09-28 20:02:16,773 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=14950f04288c511c3d378e0dc1bebaa5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:16,773 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=94338e40c9d34d323ac2b634d0630a8f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:16,774 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695931336108.14950f04288c511c3d378e0dc1bebaa5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695931336773"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695931336773"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695931336773"}]},"ts":"1695931336773"} 2023-09-28 20:02:16,774 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695931336108.94338e40c9d34d323ac2b634d0630a8f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695931336773"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695931336773"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695931336773"}]},"ts":"1695931336773"} 2023-09-28 20:02:16,775 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 14950f04288c511c3d378e0dc1bebaa5, server=jenkins-hbase4.apache.org,33091,1695931262281}] 2023-09-28 20:02:16,776 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 94338e40c9d34d323ac2b634d0630a8f, server=jenkins-hbase4.apache.org,46795,1695931262192}] 2023-09-28 20:02:16,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-28 20:02:16,927 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 14950f04288c511c3d378e0dc1bebaa5 2023-09-28 20:02:16,927 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 94338e40c9d34d323ac2b634d0630a8f 2023-09-28 20:02:16,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 14950f04288c511c3d378e0dc1bebaa5, disabling compactions & flushes 2023-09-28 20:02:16,930 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 94338e40c9d34d323ac2b634d0630a8f, disabling compactions & flushes 2023-09-28 20:02:16,930 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695931336108.14950f04288c511c3d378e0dc1bebaa5. 2023-09-28 20:02:16,930 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695931336108.94338e40c9d34d323ac2b634d0630a8f. 2023-09-28 20:02:16,930 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695931336108.14950f04288c511c3d378e0dc1bebaa5. 2023-09-28 20:02:16,930 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695931336108.94338e40c9d34d323ac2b634d0630a8f. 2023-09-28 20:02:16,930 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695931336108.14950f04288c511c3d378e0dc1bebaa5. after waiting 0 ms 2023-09-28 20:02:16,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695931336108.14950f04288c511c3d378e0dc1bebaa5. 2023-09-28 20:02:16,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695931336108.94338e40c9d34d323ac2b634d0630a8f. after waiting 0 ms 2023-09-28 20:02:16,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695931336108.94338e40c9d34d323ac2b634d0630a8f. 2023-09-28 20:02:16,931 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 14950f04288c511c3d378e0dc1bebaa5 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-28 20:02:16,931 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 94338e40c9d34d323ac2b634d0630a8f 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-28 20:02:16,943 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/94338e40c9d34d323ac2b634d0630a8f/.tmp/cf/9f2b3f3763f2441583ae1375e55c36e9 2023-09-28 20:02:16,943 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/14950f04288c511c3d378e0dc1bebaa5/.tmp/cf/7e8a7e7f8678404ead1985051475df60 2023-09-28 20:02:16,950 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/14950f04288c511c3d378e0dc1bebaa5/.tmp/cf/7e8a7e7f8678404ead1985051475df60 as hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/14950f04288c511c3d378e0dc1bebaa5/cf/7e8a7e7f8678404ead1985051475df60 2023-09-28 20:02:16,951 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/94338e40c9d34d323ac2b634d0630a8f/.tmp/cf/9f2b3f3763f2441583ae1375e55c36e9 as hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/94338e40c9d34d323ac2b634d0630a8f/cf/9f2b3f3763f2441583ae1375e55c36e9 2023-09-28 20:02:16,956 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/14950f04288c511c3d378e0dc1bebaa5/cf/7e8a7e7f8678404ead1985051475df60, entries=1, sequenceid=5, filesize=4.7 K 2023-09-28 20:02:16,956 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/94338e40c9d34d323ac2b634d0630a8f/cf/9f2b3f3763f2441583ae1375e55c36e9, entries=1, sequenceid=5, filesize=4.7 K 2023-09-28 20:02:16,957 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 14950f04288c511c3d378e0dc1bebaa5 in 26ms, sequenceid=5, compaction requested=false 2023-09-28 20:02:16,957 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-28 20:02:16,957 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 94338e40c9d34d323ac2b634d0630a8f in 26ms, sequenceid=5, compaction requested=false 2023-09-28 20:02:16,967 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/14950f04288c511c3d378e0dc1bebaa5/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-28 20:02:16,967 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/94338e40c9d34d323ac2b634d0630a8f/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-28 20:02:16,968 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 20:02:16,968 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695931336108.14950f04288c511c3d378e0dc1bebaa5. 2023-09-28 20:02:16,968 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 20:02:16,968 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 14950f04288c511c3d378e0dc1bebaa5: 2023-09-28 20:02:16,968 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695931336108.94338e40c9d34d323ac2b634d0630a8f. 2023-09-28 20:02:16,968 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 94338e40c9d34d323ac2b634d0630a8f: 2023-09-28 20:02:16,969 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 14950f04288c511c3d378e0dc1bebaa5 2023-09-28 20:02:16,970 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=14950f04288c511c3d378e0dc1bebaa5, regionState=CLOSED 2023-09-28 20:02:16,970 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695931336108.14950f04288c511c3d378e0dc1bebaa5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695931336970"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695931336970"}]},"ts":"1695931336970"} 2023-09-28 20:02:16,970 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 94338e40c9d34d323ac2b634d0630a8f 2023-09-28 20:02:16,970 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=94338e40c9d34d323ac2b634d0630a8f, regionState=CLOSED 2023-09-28 20:02:16,970 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695931336108.94338e40c9d34d323ac2b634d0630a8f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695931336970"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695931336970"}]},"ts":"1695931336970"} 2023-09-28 20:02:16,973 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=72 2023-09-28 20:02:16,973 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 14950f04288c511c3d378e0dc1bebaa5, server=jenkins-hbase4.apache.org,33091,1695931262281 in 196 msec 2023-09-28 20:02:16,974 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=73 2023-09-28 20:02:16,974 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 94338e40c9d34d323ac2b634d0630a8f, server=jenkins-hbase4.apache.org,46795,1695931262192 in 196 msec 2023-09-28 20:02:16,974 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=14950f04288c511c3d378e0dc1bebaa5, UNASSIGN in 205 msec 2023-09-28 20:02:16,978 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=73, resume processing ppid=71 2023-09-28 20:02:16,978 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=94338e40c9d34d323ac2b634d0630a8f, UNASSIGN in 206 msec 2023-09-28 20:02:17,025 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0f995b214f2ec843f9a5b1c7ba484a26/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-09-28 20:02:17,027 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695931336108.14950f04288c511c3d378e0dc1bebaa5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-28 20:02:17,027 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695931336108.94338e40c9d34d323ac2b634d0630a8f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-28 20:02:17,027 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695931336109.0f995b214f2ec843f9a5b1c7ba484a26.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-28 20:02:17,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-28 20:02:17,078 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0f995b214f2ec843f9a5b1c7ba484a26, ASSIGN}] 2023-09-28 20:02:17,079 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0f995b214f2ec843f9a5b1c7ba484a26, ASSIGN 2023-09-28 20:02:17,080 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0f995b214f2ec843f9a5b1c7ba484a26, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,33091,1695931262281; forceNewPlan=false, retain=false 2023-09-28 20:02:17,231 INFO [jenkins-hbase4:35173] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-28 20:02:17,232 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=0f995b214f2ec843f9a5b1c7ba484a26, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:17,233 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695931336109.0f995b214f2ec843f9a5b1c7ba484a26.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695931337232"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695931337232"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695931337232"}]},"ts":"1695931337232"} 2023-09-28 20:02:17,235 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 0f995b214f2ec843f9a5b1c7ba484a26, server=jenkins-hbase4.apache.org,33091,1695931262281}] 2023-09-28 20:02:17,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-28 20:02:17,389 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695931336109.0f995b214f2ec843f9a5b1c7ba484a26. 2023-09-28 20:02:17,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0f995b214f2ec843f9a5b1c7ba484a26, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695931336109.0f995b214f2ec843f9a5b1c7ba484a26.', STARTKEY => '', ENDKEY => ''} 2023-09-28 20:02:17,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695931336109.0f995b214f2ec843f9a5b1c7ba484a26. service=AccessControlService 2023-09-28 20:02:17,390 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 20:02:17,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 0f995b214f2ec843f9a5b1c7ba484a26 2023-09-28 20:02:17,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695931336109.0f995b214f2ec843f9a5b1c7ba484a26.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 20:02:17,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0f995b214f2ec843f9a5b1c7ba484a26 2023-09-28 20:02:17,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0f995b214f2ec843f9a5b1c7ba484a26 2023-09-28 20:02:17,392 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0f995b214f2ec843f9a5b1c7ba484a26/.regioninfo 2023-09-28 20:02:17,400 INFO [StoreOpener-0f995b214f2ec843f9a5b1c7ba484a26-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0f995b214f2ec843f9a5b1c7ba484a26 2023-09-28 20:02:17,401 DEBUG [StoreOpener-0f995b214f2ec843f9a5b1c7ba484a26-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0f995b214f2ec843f9a5b1c7ba484a26/cf 2023-09-28 20:02:17,401 DEBUG [StoreOpener-0f995b214f2ec843f9a5b1c7ba484a26-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0f995b214f2ec843f9a5b1c7ba484a26/cf 2023-09-28 20:02:17,401 INFO [StoreOpener-0f995b214f2ec843f9a5b1c7ba484a26-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0f995b214f2ec843f9a5b1c7ba484a26 columnFamilyName cf 2023-09-28 20:02:17,430 DEBUG [StoreOpener-0f995b214f2ec843f9a5b1c7ba484a26-1] regionserver.HStore(539): loaded hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0f995b214f2ec843f9a5b1c7ba484a26/cf/7e8a7e7f8678404ead1985051475df60.14950f04288c511c3d378e0dc1bebaa5->hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/14950f04288c511c3d378e0dc1bebaa5/cf/7e8a7e7f8678404ead1985051475df60-top 2023-09-28 20:02:17,436 DEBUG [StoreOpener-0f995b214f2ec843f9a5b1c7ba484a26-1] regionserver.HStore(539): loaded hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0f995b214f2ec843f9a5b1c7ba484a26/cf/9f2b3f3763f2441583ae1375e55c36e9.94338e40c9d34d323ac2b634d0630a8f->hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/94338e40c9d34d323ac2b634d0630a8f/cf/9f2b3f3763f2441583ae1375e55c36e9-top 2023-09-28 20:02:17,436 INFO [StoreOpener-0f995b214f2ec843f9a5b1c7ba484a26-1] regionserver.HStore(310): Store=0f995b214f2ec843f9a5b1c7ba484a26/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 20:02:17,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0f995b214f2ec843f9a5b1c7ba484a26 2023-09-28 20:02:17,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0f995b214f2ec843f9a5b1c7ba484a26 2023-09-28 20:02:17,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0f995b214f2ec843f9a5b1c7ba484a26 2023-09-28 20:02:17,442 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0f995b214f2ec843f9a5b1c7ba484a26; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65379690, jitterRate=-0.025766700506210327}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 20:02:17,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0f995b214f2ec843f9a5b1c7ba484a26: 2023-09-28 20:02:17,443 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695931336109.0f995b214f2ec843f9a5b1c7ba484a26., pid=77, masterSystemTime=1695931337386 2023-09-28 20:02:17,444 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1695931336109.0f995b214f2ec843f9a5b1c7ba484a26.,because compaction is disabled. 2023-09-28 20:02:17,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695931336109.0f995b214f2ec843f9a5b1c7ba484a26. 2023-09-28 20:02:17,445 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695931336109.0f995b214f2ec843f9a5b1c7ba484a26. 2023-09-28 20:02:17,445 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=0f995b214f2ec843f9a5b1c7ba484a26, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:17,445 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695931336109.0f995b214f2ec843f9a5b1c7ba484a26.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695931337445"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695931337445"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695931337445"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695931337445"}]},"ts":"1695931337445"} 2023-09-28 20:02:17,448 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-09-28 20:02:17,448 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 0f995b214f2ec843f9a5b1c7ba484a26, server=jenkins-hbase4.apache.org,33091,1695931262281 in 213 msec 2023-09-28 20:02:17,449 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-09-28 20:02:17,450 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0f995b214f2ec843f9a5b1c7ba484a26, ASSIGN in 370 msec 2023-09-28 20:02:17,451 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[14950f04288c511c3d378e0dc1bebaa5, 94338e40c9d34d323ac2b634d0630a8f], force=true in 709 msec 2023-09-28 20:02:17,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-28 20:02:17,856 INFO [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-09-28 20:02:17,857 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-28 20:02:17,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695931337857 (current time:1695931337857). 2023-09-28 20:02:17,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-28 20:02:17,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] zookeeper.ReadOnlyZKClient(139): Connect 0x6197f805 to 127.0.0.1:50329 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 20:02:17,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4af0c541, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 20:02:17,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 20:02:17,870 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34914, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 20:02:17,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6197f805 to 127.0.0.1:50329 2023-09-28 20:02:17,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 20:02:17,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] zookeeper.ReadOnlyZKClient(139): Connect 0x49706b56 to 127.0.0.1:50329 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 20:02:17,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@17f9e5ad, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 20:02:17,879 DEBUG [hconnection-0x5befe0de-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 20:02:17,880 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34922, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 20:02:17,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x49706b56 to 127.0.0.1:50329 2023-09-28 20:02:17,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 20:02:17,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-28 20:02:17,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-28 20:02:17,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-28 20:02:17,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-28 20:02:17,889 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-28 20:02:17,890 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1695931937890 2023-09-28 20:02:17,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-28 20:02:17,890 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,895 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-28 20:02:17,895 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-28 20:02:17,896 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-28 20:02:17,896 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-28 20:02:17,897 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 9 msec 2023-09-28 20:02:17,898 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-28 20:02:17,899 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1695931937899 2023-09-28 20:02:17,909 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,909 INFO [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-09-28 20:02:17,909 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 20:02:17,911 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-09-28 20:02:17,911 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-09-28 20:02:17,911 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,911 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,914 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:02:17,914 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:17,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:02:17,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:02:17,914 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:02:17,914 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:02:17,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:02:17,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:02:17,914 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:17,914 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-28 20:02:17,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:02:17,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:02:17,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,915 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,915 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,915 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-28 20:02:17,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-28 20:02:17,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,916 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-28 20:02:17,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-28 20:02:17,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,916 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-28 20:02:17,916 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-28 20:02:17,916 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,916 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-28 20:02:17,916 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 20:02:17,916 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,918 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,918 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-28 20:02:17,918 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-28 20:02:17,918 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 20:02:17,918 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 20:02:17,917 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-28 20:02:17,920 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-28 20:02:17,920 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-28 20:02:17,920 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-28 20:02:17,920 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33091,1695931262281' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-28 20:02:17,919 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-28 20:02:17,920 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46795,1695931262192' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-28 20:02:17,920 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-28 20:02:17,920 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38759,1695931262240' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-28 20:02:17,921 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:17,921 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:17,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:02:17,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:02:17,921 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,922 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,922 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,922 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 20:02:17,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:02:17,922 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,922 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 20:02:17,922 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,923 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 20:02:17,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:02:17,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:17,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:17,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:17,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:02:17,924 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33091,1695931262281' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-09-28 20:02:17,924 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ec4259a[Count = 0] remaining members to acquire global barrier 2023-09-28 20:02:17,924 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-09-28 20:02:17,924 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,925 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,925 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,925 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:17,925 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-28 20:02:17,925 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,925 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-28 20:02:17,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,925 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-28 20:02:17,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,926 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-28 20:02:17,926 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-28 20:02:17,926 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-28 20:02:17,926 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,46795,1695931262192' in zk 2023-09-28 20:02:17,925 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,38759,1695931262240' in zk 2023-09-28 20:02:17,926 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 20:02:17,926 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 20:02:17,926 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695931336109.0f995b214f2ec843f9a5b1c7ba484a26. 2023-09-28 20:02:17,926 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695931336109.0f995b214f2ec843f9a5b1c7ba484a26. started... 2023-09-28 20:02:17,927 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0f995b214f2ec843f9a5b1c7ba484a26: 2023-09-28 20:02:17,928 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695931336109.0f995b214f2ec843f9a5b1c7ba484a26.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,928 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 20:02:17,928 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0f995b214f2ec843f9a5b1c7ba484a26/cf/7e8a7e7f8678404ead1985051475df60.14950f04288c511c3d378e0dc1bebaa5->hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/14950f04288c511c3d378e0dc1bebaa5/cf/7e8a7e7f8678404ead1985051475df60-top, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0f995b214f2ec843f9a5b1c7ba484a26/cf/9f2b3f3763f2441583ae1375e55c36e9.94338e40c9d34d323ac2b634d0630a8f->hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/94338e40c9d34d323ac2b634d0630a8f/cf/9f2b3f3763f2441583ae1375e55c36e9-top] hfiles 2023-09-28 20:02:17,928 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0f995b214f2ec843f9a5b1c7ba484a26/cf/7e8a7e7f8678404ead1985051475df60.14950f04288c511c3d378e0dc1bebaa5 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,928 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0f995b214f2ec843f9a5b1c7ba484a26/cf/9f2b3f3763f2441583ae1375e55c36e9.94338e40c9d34d323ac2b634d0630a8f for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,930 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-28 20:02:17,930 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 20:02:17,930 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-28 20:02:17,931 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-28 20:02:17,931 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 20:02:17,931 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-28 20:02:17,943 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695931336109.0f995b214f2ec843f9a5b1c7ba484a26. completed. 2023-09-28 20:02:17,943 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695931336109.0f995b214f2ec843f9a5b1c7ba484a26. 2023-09-28 20:02:17,943 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 20:02:17,943 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 20:02:17,943 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:17,943 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-28 20:02:17,943 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,33091,1695931262281' in zk 2023-09-28 20:02:17,948 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-28 20:02:17,948 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:17,948 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 20:02:17,948 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-28 20:02:17,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:17,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:02:17,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:02:17,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:02:17,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:02:17,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:17,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:17,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:17,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:02:17,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:17,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:17,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:17,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,33091,1695931262281': 2023-09-28 20:02:17,952 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33091,1695931262281' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-09-28 20:02:17,952 INFO [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-09-28 20:02:17,952 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-28 20:02:17,952 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-28 20:02:17,952 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,952 INFO [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-28 20:02:17,953 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,953 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,953 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:02:17,953 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,953 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,954 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:02:17,954 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:02:17,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:02:17,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:02:17,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:02:17,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:02:17,954 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:17,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:02:17,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:02:17,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:02:17,954 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:17,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:02:17,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:02:17,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,955 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:17,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:02:17,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:17,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:17,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:17,957 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:17,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:02:17,957 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:17,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,957 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:17,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:17,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:17,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:17,960 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:17,960 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:02:17,960 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:02:17,961 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:02:17,961 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:02:17,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:02:17,960 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:02:17,960 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:02:17,961 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:17,961 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:02:17,961 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,961 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 20:02:17,961 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:02:17,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:02:17,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:02:17,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:02:17,961 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:17,961 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,961 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:17,962 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,962 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:17,962 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:17,962 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,962 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:02:17,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:02:17,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:02:17,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:02:17,962 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:02:17,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:02:17,984 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,985 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-09-28 20:02:17,985 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,985 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:17,985 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1695931337890Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695931337961 (+71 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695931337961Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695931337965 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695931337977 (+12 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1695931337985 (+8 ms) 2023-09-28 20:02:17,988 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-28 20:02:17,989 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 94 msec 2023-09-28 20:02:17,996 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 20:02:17,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-09-28 20:02:17,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-28 20:02:17,997 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/export-test/export-1695931337997 2023-09-28 20:02:17,998 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43143, tgtDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/export-test/export-1695931337997, rawTgtDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/export-test/export-1695931337997, srcFsUri=hdfs://localhost:43143, srcDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff 2023-09-28 20:02:18,020 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43143, inputRoot=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff 2023-09-28 20:02:18,021 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-387081967_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/export-test/export-1695931337997, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/export-test/export-1695931337997/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:18,021 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43143, inputRoot=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff, snapshotDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-09-28 20:02:18,030 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/export-test/export-1695931337997/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:18,050 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-28 20:02:18,050 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-28 20:02:18,051 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-28 20:02:18,051 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-28 20:02:18,928 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/hadoop-8670210492452434332.jar 2023-09-28 20:02:18,928 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-28 20:02:18,928 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-28 20:02:18,996 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/hadoop-2116107115046407359.jar 2023-09-28 20:02:18,996 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-28 20:02:18,997 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-28 20:02:18,997 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-28 20:02:18,998 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-28 20:02:18,998 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-28 20:02:18,998 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-28 20:02:18,999 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-28 20:02:18,999 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-28 20:02:18,999 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-28 20:02:19,000 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-28 20:02:19,000 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-28 20:02:19,001 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-28 20:02:19,001 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-28 20:02:19,001 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-28 20:02:19,001 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-28 20:02:19,002 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-28 20:02:19,003 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 20:02:19,003 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 20:02:19,003 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 20:02:19,004 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 20:02:19,004 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 20:02:19,004 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 20:02:19,005 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 20:02:19,158 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695931268848_0004_000001 (auth:SIMPLE) 2023-09-28 20:02:19,373 WARN [Listener at jenkins-hbase4.apache.org/41509] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-28 20:02:19,375 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-09-28 20:02:19,377 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-09-28 20:02:19,435 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 20:02:19,436 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 20:02:20,016 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-28 20:02:20,163 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695931268848_0005_000001 (auth:SIMPLE) 2023-09-28 20:02:23,943 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695931268848_0005_000001 (auth:SIMPLE) 2023-09-28 20:02:26,165 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695931268848_0005_000001 (auth:SIMPLE) 2023-09-28 20:02:28,559 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695931268848_0005_000001 (auth:SIMPLE) 2023-09-28 20:02:30,542 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-28 20:02:30,543 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-28 20:02:30,551 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:30,552 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-28 20:02:30,552 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-28 20:02:30,552 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_394157282_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:30,553 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(367): hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-28 20:02:30,553 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(367): hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-28 20:02:30,553 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_394157282_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/export-test/export-1695931337997/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/export-test/export-1695931337997/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:30,553 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(367): hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/export-test/export-1695931337997/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-28 20:02:30,554 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(367): hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/export-test/export-1695931337997/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-28 20:02:30,561 INFO [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:30,561 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:30,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:30,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-28 20:02:30,565 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695931350565"}]},"ts":"1695931350565"} 2023-09-28 20:02:30,567 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-09-28 20:02:30,569 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-09-28 20:02:30,570 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0f995b214f2ec843f9a5b1c7ba484a26, UNASSIGN}] 2023-09-28 20:02:30,572 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0f995b214f2ec843f9a5b1c7ba484a26, UNASSIGN 2023-09-28 20:02:30,573 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=0f995b214f2ec843f9a5b1c7ba484a26, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:30,573 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695931336109.0f995b214f2ec843f9a5b1c7ba484a26.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695931350572"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695931350572"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695931350572"}]},"ts":"1695931350572"} 2023-09-28 20:02:30,574 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 0f995b214f2ec843f9a5b1c7ba484a26, server=jenkins-hbase4.apache.org,33091,1695931262281}] 2023-09-28 20:02:30,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-28 20:02:30,726 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0f995b214f2ec843f9a5b1c7ba484a26 2023-09-28 20:02:30,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0f995b214f2ec843f9a5b1c7ba484a26, disabling compactions & flushes 2023-09-28 20:02:30,726 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695931336109.0f995b214f2ec843f9a5b1c7ba484a26. 2023-09-28 20:02:30,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695931336109.0f995b214f2ec843f9a5b1c7ba484a26. 2023-09-28 20:02:30,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695931336109.0f995b214f2ec843f9a5b1c7ba484a26. after waiting 0 ms 2023-09-28 20:02:30,727 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695931336109.0f995b214f2ec843f9a5b1c7ba484a26. 2023-09-28 20:02:30,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0f995b214f2ec843f9a5b1c7ba484a26/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-09-28 20:02:30,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 20:02:30,745 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695931336109.0f995b214f2ec843f9a5b1c7ba484a26. 2023-09-28 20:02:30,745 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0f995b214f2ec843f9a5b1c7ba484a26: 2023-09-28 20:02:30,747 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0f995b214f2ec843f9a5b1c7ba484a26 2023-09-28 20:02:30,747 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=0f995b214f2ec843f9a5b1c7ba484a26, regionState=CLOSED 2023-09-28 20:02:30,747 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695931336109.0f995b214f2ec843f9a5b1c7ba484a26.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695931350747"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695931350747"}]},"ts":"1695931350747"} 2023-09-28 20:02:30,750 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-09-28 20:02:30,750 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 0f995b214f2ec843f9a5b1c7ba484a26, server=jenkins-hbase4.apache.org,33091,1695931262281 in 175 msec 2023-09-28 20:02:30,751 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-09-28 20:02:30,751 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0f995b214f2ec843f9a5b1c7ba484a26, UNASSIGN in 180 msec 2023-09-28 20:02:30,752 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695931350752"}]},"ts":"1695931350752"} 2023-09-28 20:02:30,753 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-09-28 20:02:30,754 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-09-28 20:02:30,756 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 194 msec 2023-09-28 20:02:30,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-28 20:02:30,868 INFO [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-09-28 20:02:30,869 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:30,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:30,872 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:30,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:30,873 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:30,874 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33091] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:30,877 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/94338e40c9d34d323ac2b634d0630a8f 2023-09-28 20:02:30,877 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0f995b214f2ec843f9a5b1c7ba484a26 2023-09-28 20:02:30,877 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/14950f04288c511c3d378e0dc1bebaa5 2023-09-28 20:02:30,878 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/94338e40c9d34d323ac2b634d0630a8f/cf, FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/94338e40c9d34d323ac2b634d0630a8f/recovered.edits] 2023-09-28 20:02:30,878 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0f995b214f2ec843f9a5b1c7ba484a26/cf, FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0f995b214f2ec843f9a5b1c7ba484a26/recovered.edits] 2023-09-28 20:02:30,879 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/14950f04288c511c3d378e0dc1bebaa5/cf, FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/14950f04288c511c3d378e0dc1bebaa5/recovered.edits] 2023-09-28 20:02:30,881 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:30,881 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:30,881 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:30,881 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:30,881 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-28 20:02:30,881 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-28 20:02:30,883 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:30,883 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 20:02:30,883 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/94338e40c9d34d323ac2b634d0630a8f/cf/9f2b3f3763f2441583ae1375e55c36e9 to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/94338e40c9d34d323ac2b634d0630a8f/cf/9f2b3f3763f2441583ae1375e55c36e9 2023-09-28 20:02:30,883 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 20:02:30,883 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:30,883 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 20:02:30,883 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 20:02:30,883 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-09-28 20:02:30,883 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-28 20:02:30,883 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-09-28 20:02:30,884 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-28 20:02:30,884 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0f995b214f2ec843f9a5b1c7ba484a26/cf/7e8a7e7f8678404ead1985051475df60.14950f04288c511c3d378e0dc1bebaa5 to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0f995b214f2ec843f9a5b1c7ba484a26/cf/7e8a7e7f8678404ead1985051475df60.14950f04288c511c3d378e0dc1bebaa5 2023-09-28 20:02:30,884 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-28 20:02:30,884 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/14950f04288c511c3d378e0dc1bebaa5/cf/7e8a7e7f8678404ead1985051475df60 to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/14950f04288c511c3d378e0dc1bebaa5/cf/7e8a7e7f8678404ead1985051475df60 2023-09-28 20:02:30,884 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-28 20:02:30,885 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-28 20:02:30,885 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-28 20:02:30,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-28 20:02:30,890 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0f995b214f2ec843f9a5b1c7ba484a26/cf/9f2b3f3763f2441583ae1375e55c36e9.94338e40c9d34d323ac2b634d0630a8f to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0f995b214f2ec843f9a5b1c7ba484a26/cf/9f2b3f3763f2441583ae1375e55c36e9.94338e40c9d34d323ac2b634d0630a8f 2023-09-28 20:02:30,892 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/94338e40c9d34d323ac2b634d0630a8f/recovered.edits/8.seqid to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/94338e40c9d34d323ac2b634d0630a8f/recovered.edits/8.seqid 2023-09-28 20:02:30,893 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/14950f04288c511c3d378e0dc1bebaa5/recovered.edits/8.seqid to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/14950f04288c511c3d378e0dc1bebaa5/recovered.edits/8.seqid 2023-09-28 20:02:30,893 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/94338e40c9d34d323ac2b634d0630a8f 2023-09-28 20:02:30,893 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/14950f04288c511c3d378e0dc1bebaa5 2023-09-28 20:02:30,894 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0f995b214f2ec843f9a5b1c7ba484a26/recovered.edits/12.seqid to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0f995b214f2ec843f9a5b1c7ba484a26/recovered.edits/12.seqid 2023-09-28 20:02:30,894 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0f995b214f2ec843f9a5b1c7ba484a26 2023-09-28 20:02:30,894 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-28 20:02:30,896 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:30,899 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-09-28 20:02:30,901 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-09-28 20:02:30,902 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:30,902 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-09-28 20:02:30,902 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695931336109.0f995b214f2ec843f9a5b1c7ba484a26.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695931350902"}]},"ts":"9223372036854775807"} 2023-09-28 20:02:30,904 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-09-28 20:02:30,904 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0f995b214f2ec843f9a5b1c7ba484a26, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695931336109.0f995b214f2ec843f9a5b1c7ba484a26.', STARTKEY => '', ENDKEY => ''}] 2023-09-28 20:02:30,904 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-09-28 20:02:30,904 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695931350904"}]},"ts":"9223372036854775807"} 2023-09-28 20:02:30,905 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-09-28 20:02:30,907 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:30,908 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 38 msec 2023-09-28 20:02:30,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-28 20:02:30,986 INFO [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-09-28 20:02:30,987 INFO [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:30,987 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:30,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:30,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-28 20:02:30,991 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695931350991"}]},"ts":"1695931350991"} 2023-09-28 20:02:30,993 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-09-28 20:02:30,994 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-09-28 20:02:30,995 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=bbd9ba775b880b2737e4a5caf8e27a3d, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a4219038cfe3706074acd9e496dcc3b4, UNASSIGN}] 2023-09-28 20:02:30,997 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=bbd9ba775b880b2737e4a5caf8e27a3d, UNASSIGN 2023-09-28 20:02:30,997 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a4219038cfe3706074acd9e496dcc3b4, UNASSIGN 2023-09-28 20:02:30,998 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=bbd9ba775b880b2737e4a5caf8e27a3d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:30,998 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=a4219038cfe3706074acd9e496dcc3b4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:30,998 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695931334733.a4219038cfe3706074acd9e496dcc3b4.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695931350998"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695931350998"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695931350998"}]},"ts":"1695931350998"} 2023-09-28 20:02:30,998 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695931334733.bbd9ba775b880b2737e4a5caf8e27a3d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695931350998"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695931350998"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695931350998"}]},"ts":"1695931350998"} 2023-09-28 20:02:30,999 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure a4219038cfe3706074acd9e496dcc3b4, server=jenkins-hbase4.apache.org,33091,1695931262281}] 2023-09-28 20:02:31,000 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure bbd9ba775b880b2737e4a5caf8e27a3d, server=jenkins-hbase4.apache.org,46795,1695931262192}] 2023-09-28 20:02:31,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-28 20:02:31,150 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a4219038cfe3706074acd9e496dcc3b4 2023-09-28 20:02:31,150 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a4219038cfe3706074acd9e496dcc3b4, disabling compactions & flushes 2023-09-28 20:02:31,151 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695931334733.a4219038cfe3706074acd9e496dcc3b4. 2023-09-28 20:02:31,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695931334733.a4219038cfe3706074acd9e496dcc3b4. 2023-09-28 20:02:31,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695931334733.a4219038cfe3706074acd9e496dcc3b4. after waiting 0 ms 2023-09-28 20:02:31,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695931334733.a4219038cfe3706074acd9e496dcc3b4. 2023-09-28 20:02:31,153 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close bbd9ba775b880b2737e4a5caf8e27a3d 2023-09-28 20:02:31,154 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bbd9ba775b880b2737e4a5caf8e27a3d, disabling compactions & flushes 2023-09-28 20:02:31,155 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695931334733.bbd9ba775b880b2737e4a5caf8e27a3d. 2023-09-28 20:02:31,155 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695931334733.bbd9ba775b880b2737e4a5caf8e27a3d. 2023-09-28 20:02:31,155 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695931334733.bbd9ba775b880b2737e4a5caf8e27a3d. after waiting 0 ms 2023-09-28 20:02:31,155 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695931334733.bbd9ba775b880b2737e4a5caf8e27a3d. 2023-09-28 20:02:31,161 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion/a4219038cfe3706074acd9e496dcc3b4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-28 20:02:31,162 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 20:02:31,162 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithMergeRegion/bbd9ba775b880b2737e4a5caf8e27a3d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-28 20:02:31,163 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695931334733.a4219038cfe3706074acd9e496dcc3b4. 2023-09-28 20:02:31,163 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a4219038cfe3706074acd9e496dcc3b4: 2023-09-28 20:02:31,163 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 20:02:31,164 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695931334733.bbd9ba775b880b2737e4a5caf8e27a3d. 2023-09-28 20:02:31,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bbd9ba775b880b2737e4a5caf8e27a3d: 2023-09-28 20:02:31,165 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a4219038cfe3706074acd9e496dcc3b4 2023-09-28 20:02:31,166 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=a4219038cfe3706074acd9e496dcc3b4, regionState=CLOSED 2023-09-28 20:02:31,166 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695931334733.a4219038cfe3706074acd9e496dcc3b4.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695931351166"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695931351166"}]},"ts":"1695931351166"} 2023-09-28 20:02:31,166 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed bbd9ba775b880b2737e4a5caf8e27a3d 2023-09-28 20:02:31,166 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=bbd9ba775b880b2737e4a5caf8e27a3d, regionState=CLOSED 2023-09-28 20:02:31,166 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695931334733.bbd9ba775b880b2737e4a5caf8e27a3d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695931351166"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695931351166"}]},"ts":"1695931351166"} 2023-09-28 20:02:31,169 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=86 2023-09-28 20:02:31,169 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure a4219038cfe3706074acd9e496dcc3b4, server=jenkins-hbase4.apache.org,33091,1695931262281 in 168 msec 2023-09-28 20:02:31,169 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=85 2023-09-28 20:02:31,169 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure bbd9ba775b880b2737e4a5caf8e27a3d, server=jenkins-hbase4.apache.org,46795,1695931262192 in 168 msec 2023-09-28 20:02:31,170 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a4219038cfe3706074acd9e496dcc3b4, UNASSIGN in 174 msec 2023-09-28 20:02:31,171 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=85, resume processing ppid=84 2023-09-28 20:02:31,171 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=bbd9ba775b880b2737e4a5caf8e27a3d, UNASSIGN in 174 msec 2023-09-28 20:02:31,172 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695931351171"}]},"ts":"1695931351171"} 2023-09-28 20:02:31,173 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-09-28 20:02:31,174 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-09-28 20:02:31,176 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 188 msec 2023-09-28 20:02:31,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-28 20:02:31,294 INFO [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-09-28 20:02:31,295 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:31,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:31,298 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:31,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:31,299 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:31,300 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33091] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:31,303 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/bbd9ba775b880b2737e4a5caf8e27a3d 2023-09-28 20:02:31,303 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a4219038cfe3706074acd9e496dcc3b4 2023-09-28 20:02:31,304 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/bbd9ba775b880b2737e4a5caf8e27a3d/cf, FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/bbd9ba775b880b2737e4a5caf8e27a3d/recovered.edits] 2023-09-28 20:02:31,305 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a4219038cfe3706074acd9e496dcc3b4/cf, FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a4219038cfe3706074acd9e496dcc3b4/recovered.edits] 2023-09-28 20:02:31,308 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:31,308 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:31,308 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:31,308 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:31,308 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-28 20:02:31,308 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-28 20:02:31,308 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-28 20:02:31,308 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-28 20:02:31,309 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:31,309 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:31,309 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 20:02:31,309 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:31,309 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:31,309 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 20:02:31,309 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 20:02:31,309 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 20:02:31,310 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a4219038cfe3706074acd9e496dcc3b4/cf/b82165483a4843afbfba0ae8d58354ed to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/a4219038cfe3706074acd9e496dcc3b4/cf/b82165483a4843afbfba0ae8d58354ed 2023-09-28 20:02:31,310 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/bbd9ba775b880b2737e4a5caf8e27a3d/cf/4159b4f4f5d14a6fa496848f4eb10df3 to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/bbd9ba775b880b2737e4a5caf8e27a3d/cf/4159b4f4f5d14a6fa496848f4eb10df3 2023-09-28 20:02:31,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-28 20:02:31,313 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a4219038cfe3706074acd9e496dcc3b4/recovered.edits/9.seqid to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/a4219038cfe3706074acd9e496dcc3b4/recovered.edits/9.seqid 2023-09-28 20:02:31,313 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/bbd9ba775b880b2737e4a5caf8e27a3d/recovered.edits/9.seqid to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/bbd9ba775b880b2737e4a5caf8e27a3d/recovered.edits/9.seqid 2023-09-28 20:02:31,313 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a4219038cfe3706074acd9e496dcc3b4 2023-09-28 20:02:31,314 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/bbd9ba775b880b2737e4a5caf8e27a3d 2023-09-28 20:02:31,314 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-28 20:02:31,314 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-28 20:02:31,315 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-09-28 20:02:31,318 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230928fb6cd2793d9c4ee1b566b45228bdd762 to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230928fb6cd2793d9c4ee1b566b45228bdd762 2023-09-28 20:02:31,319 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202309282e2f227936bc4d83b4629efe361ce979 to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202309282e2f227936bc4d83b4629efe361ce979 2023-09-28 20:02:31,320 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-28 20:02:31,322 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:31,324 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-09-28 20:02:31,326 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-09-28 20:02:31,327 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:31,327 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-09-28 20:02:31,327 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695931334733.bbd9ba775b880b2737e4a5caf8e27a3d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695931351327"}]},"ts":"9223372036854775807"} 2023-09-28 20:02:31,327 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695931334733.a4219038cfe3706074acd9e496dcc3b4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695931351327"}]},"ts":"9223372036854775807"} 2023-09-28 20:02:31,329 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-28 20:02:31,329 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => bbd9ba775b880b2737e4a5caf8e27a3d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695931334733.bbd9ba775b880b2737e4a5caf8e27a3d.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => a4219038cfe3706074acd9e496dcc3b4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695931334733.a4219038cfe3706074acd9e496dcc3b4.', STARTKEY => '1', ENDKEY => ''}] 2023-09-28 20:02:31,329 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-09-28 20:02:31,329 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695931351329"}]},"ts":"9223372036854775807"} 2023-09-28 20:02:31,330 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-09-28 20:02:31,332 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:31,333 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 37 msec 2023-09-28 20:02:31,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-28 20:02:31,412 INFO [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-09-28 20:02:31,421 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-28 20:02:31,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:31,424 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-28 20:02:31,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 20:02:31,427 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-09-28 20:02:31,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 20:02:31,452 INFO [Listener at jenkins-hbase4.apache.org/41509] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=757 (was 749) Potentially hanging thread: hconnection-0x1dd01c2f-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_394157282_17 at /127.0.0.1:57190 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1dd01c2f-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_394157282_17 at /127.0.0.1:47756 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1dd01c2f-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_394157282_17 at /127.0.0.1:53434 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1dd01c2f-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2107210168_1 at /127.0.0.1:53406 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1dd01c2f-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3962 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:36287 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x1dd01c2f-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=908 (was 900) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=206 (was 206), ProcessCount=168 (was 168), AvailableMemoryMB=4554 (was 4603) 2023-09-28 20:02:31,452 WARN [Listener at jenkins-hbase4.apache.org/41509] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-09-28 20:02:31,472 INFO [Listener at jenkins-hbase4.apache.org/41509] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=757, OpenFileDescriptor=908, MaxFileDescriptor=60000, SystemLoadAverage=206, ProcessCount=168, AvailableMemoryMB=4554 2023-09-28 20:02:31,472 WARN [Listener at jenkins-hbase4.apache.org/41509] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-09-28 20:02:31,474 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-28 20:02:31,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-28 20:02:31,477 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-28 20:02:31,478 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-09-28 20:02:31,478 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-28 20:02:31,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-28 20:02:31,480 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testEmptyExportFileSystemState/b322dc12642dbceccbb71430f54b1dd8 2023-09-28 20:02:31,480 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testEmptyExportFileSystemState/f9227f994ae7cf9a1fd50d077ad33ffc 2023-09-28 20:02:31,481 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testEmptyExportFileSystemState/f9227f994ae7cf9a1fd50d077ad33ffc empty. 2023-09-28 20:02:31,481 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testEmptyExportFileSystemState/b322dc12642dbceccbb71430f54b1dd8 empty. 2023-09-28 20:02:31,481 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testEmptyExportFileSystemState/f9227f994ae7cf9a1fd50d077ad33ffc 2023-09-28 20:02:31,481 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testEmptyExportFileSystemState/b322dc12642dbceccbb71430f54b1dd8 2023-09-28 20:02:31,481 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-28 20:02:31,490 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-28 20:02:31,491 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => b322dc12642dbceccbb71430f54b1dd8, NAME => 'testtb-testEmptyExportFileSystemState,,1695931351474.b322dc12642dbceccbb71430f54b1dd8.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp 2023-09-28 20:02:31,491 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => f9227f994ae7cf9a1fd50d077ad33ffc, NAME => 'testtb-testEmptyExportFileSystemState,1,1695931351474.f9227f994ae7cf9a1fd50d077ad33ffc.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp 2023-09-28 20:02:31,499 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695931351474.f9227f994ae7cf9a1fd50d077ad33ffc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 20:02:31,499 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695931351474.b322dc12642dbceccbb71430f54b1dd8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 20:02:31,499 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing f9227f994ae7cf9a1fd50d077ad33ffc, disabling compactions & flushes 2023-09-28 20:02:31,499 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing b322dc12642dbceccbb71430f54b1dd8, disabling compactions & flushes 2023-09-28 20:02:31,499 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695931351474.f9227f994ae7cf9a1fd50d077ad33ffc. 2023-09-28 20:02:31,499 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695931351474.f9227f994ae7cf9a1fd50d077ad33ffc. 2023-09-28 20:02:31,499 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695931351474.b322dc12642dbceccbb71430f54b1dd8. 2023-09-28 20:02:31,499 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695931351474.b322dc12642dbceccbb71430f54b1dd8. 2023-09-28 20:02:31,499 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695931351474.f9227f994ae7cf9a1fd50d077ad33ffc. after waiting 0 ms 2023-09-28 20:02:31,499 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695931351474.f9227f994ae7cf9a1fd50d077ad33ffc. 2023-09-28 20:02:31,499 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695931351474.b322dc12642dbceccbb71430f54b1dd8. after waiting 0 ms 2023-09-28 20:02:31,499 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695931351474.f9227f994ae7cf9a1fd50d077ad33ffc. 2023-09-28 20:02:31,499 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695931351474.b322dc12642dbceccbb71430f54b1dd8. 2023-09-28 20:02:31,499 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for f9227f994ae7cf9a1fd50d077ad33ffc: 2023-09-28 20:02:31,499 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695931351474.b322dc12642dbceccbb71430f54b1dd8. 2023-09-28 20:02:31,500 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for b322dc12642dbceccbb71430f54b1dd8: 2023-09-28 20:02:31,501 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-28 20:02:31,502 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695931351474.f9227f994ae7cf9a1fd50d077ad33ffc.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695931351502"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695931351502"}]},"ts":"1695931351502"} 2023-09-28 20:02:31,502 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695931351474.b322dc12642dbceccbb71430f54b1dd8.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695931351502"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695931351502"}]},"ts":"1695931351502"} 2023-09-28 20:02:31,504 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-28 20:02:31,505 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-28 20:02:31,505 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695931351505"}]},"ts":"1695931351505"} 2023-09-28 20:02:31,506 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-09-28 20:02:31,510 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-28 20:02:31,511 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-28 20:02:31,511 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-28 20:02:31,511 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-28 20:02:31,511 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-28 20:02:31,511 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b322dc12642dbceccbb71430f54b1dd8, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f9227f994ae7cf9a1fd50d077ad33ffc, ASSIGN}] 2023-09-28 20:02:31,514 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f9227f994ae7cf9a1fd50d077ad33ffc, ASSIGN 2023-09-28 20:02:31,514 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b322dc12642dbceccbb71430f54b1dd8, ASSIGN 2023-09-28 20:02:31,514 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f9227f994ae7cf9a1fd50d077ad33ffc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46795,1695931262192; forceNewPlan=false, retain=false 2023-09-28 20:02:31,514 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b322dc12642dbceccbb71430f54b1dd8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33091,1695931262281; forceNewPlan=false, retain=false 2023-09-28 20:02:31,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-28 20:02:31,664 INFO [jenkins-hbase4:35173] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-28 20:02:31,667 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=b322dc12642dbceccbb71430f54b1dd8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:31,667 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=f9227f994ae7cf9a1fd50d077ad33ffc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:31,667 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695931351474.b322dc12642dbceccbb71430f54b1dd8.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695931351667"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695931351667"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695931351667"}]},"ts":"1695931351667"} 2023-09-28 20:02:31,667 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695931351474.f9227f994ae7cf9a1fd50d077ad33ffc.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695931351667"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695931351667"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695931351667"}]},"ts":"1695931351667"} 2023-09-28 20:02:31,669 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure b322dc12642dbceccbb71430f54b1dd8, server=jenkins-hbase4.apache.org,33091,1695931262281}] 2023-09-28 20:02:31,670 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure f9227f994ae7cf9a1fd50d077ad33ffc, server=jenkins-hbase4.apache.org,46795,1695931262192}] 2023-09-28 20:02:31,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-28 20:02:31,824 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1695931351474.f9227f994ae7cf9a1fd50d077ad33ffc. 2023-09-28 20:02:31,824 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1695931351474.b322dc12642dbceccbb71430f54b1dd8. 2023-09-28 20:02:31,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f9227f994ae7cf9a1fd50d077ad33ffc, NAME => 'testtb-testEmptyExportFileSystemState,1,1695931351474.f9227f994ae7cf9a1fd50d077ad33ffc.', STARTKEY => '1', ENDKEY => ''} 2023-09-28 20:02:31,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b322dc12642dbceccbb71430f54b1dd8, NAME => 'testtb-testEmptyExportFileSystemState,,1695931351474.b322dc12642dbceccbb71430f54b1dd8.', STARTKEY => '', ENDKEY => '1'} 2023-09-28 20:02:31,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1695931351474.f9227f994ae7cf9a1fd50d077ad33ffc. service=AccessControlService 2023-09-28 20:02:31,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1695931351474.b322dc12642dbceccbb71430f54b1dd8. service=AccessControlService 2023-09-28 20:02:31,825 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 20:02:31,825 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 20:02:31,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState f9227f994ae7cf9a1fd50d077ad33ffc 2023-09-28 20:02:31,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState b322dc12642dbceccbb71430f54b1dd8 2023-09-28 20:02:31,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695931351474.f9227f994ae7cf9a1fd50d077ad33ffc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 20:02:31,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695931351474.b322dc12642dbceccbb71430f54b1dd8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 20:02:31,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f9227f994ae7cf9a1fd50d077ad33ffc 2023-09-28 20:02:31,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b322dc12642dbceccbb71430f54b1dd8 2023-09-28 20:02:31,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b322dc12642dbceccbb71430f54b1dd8 2023-09-28 20:02:31,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f9227f994ae7cf9a1fd50d077ad33ffc 2023-09-28 20:02:31,826 INFO [StoreOpener-f9227f994ae7cf9a1fd50d077ad33ffc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f9227f994ae7cf9a1fd50d077ad33ffc 2023-09-28 20:02:31,826 INFO [StoreOpener-b322dc12642dbceccbb71430f54b1dd8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b322dc12642dbceccbb71430f54b1dd8 2023-09-28 20:02:31,827 DEBUG [StoreOpener-f9227f994ae7cf9a1fd50d077ad33ffc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testEmptyExportFileSystemState/f9227f994ae7cf9a1fd50d077ad33ffc/cf 2023-09-28 20:02:31,828 DEBUG [StoreOpener-f9227f994ae7cf9a1fd50d077ad33ffc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testEmptyExportFileSystemState/f9227f994ae7cf9a1fd50d077ad33ffc/cf 2023-09-28 20:02:31,828 DEBUG [StoreOpener-b322dc12642dbceccbb71430f54b1dd8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testEmptyExportFileSystemState/b322dc12642dbceccbb71430f54b1dd8/cf 2023-09-28 20:02:31,828 DEBUG [StoreOpener-b322dc12642dbceccbb71430f54b1dd8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testEmptyExportFileSystemState/b322dc12642dbceccbb71430f54b1dd8/cf 2023-09-28 20:02:31,828 INFO [StoreOpener-f9227f994ae7cf9a1fd50d077ad33ffc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f9227f994ae7cf9a1fd50d077ad33ffc columnFamilyName cf 2023-09-28 20:02:31,828 INFO [StoreOpener-b322dc12642dbceccbb71430f54b1dd8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b322dc12642dbceccbb71430f54b1dd8 columnFamilyName cf 2023-09-28 20:02:31,829 INFO [StoreOpener-b322dc12642dbceccbb71430f54b1dd8-1] regionserver.HStore(310): Store=b322dc12642dbceccbb71430f54b1dd8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 20:02:31,829 INFO [StoreOpener-f9227f994ae7cf9a1fd50d077ad33ffc-1] regionserver.HStore(310): Store=f9227f994ae7cf9a1fd50d077ad33ffc/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 20:02:31,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testEmptyExportFileSystemState/b322dc12642dbceccbb71430f54b1dd8 2023-09-28 20:02:31,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testEmptyExportFileSystemState/f9227f994ae7cf9a1fd50d077ad33ffc 2023-09-28 20:02:31,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testEmptyExportFileSystemState/b322dc12642dbceccbb71430f54b1dd8 2023-09-28 20:02:31,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testEmptyExportFileSystemState/f9227f994ae7cf9a1fd50d077ad33ffc 2023-09-28 20:02:31,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b322dc12642dbceccbb71430f54b1dd8 2023-09-28 20:02:31,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f9227f994ae7cf9a1fd50d077ad33ffc 2023-09-28 20:02:31,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testEmptyExportFileSystemState/b322dc12642dbceccbb71430f54b1dd8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 20:02:31,836 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b322dc12642dbceccbb71430f54b1dd8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62960119, jitterRate=-0.061821117997169495}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 20:02:31,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testEmptyExportFileSystemState/f9227f994ae7cf9a1fd50d077ad33ffc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 20:02:31,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b322dc12642dbceccbb71430f54b1dd8: 2023-09-28 20:02:31,836 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f9227f994ae7cf9a1fd50d077ad33ffc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59825232, jitterRate=-0.10853457450866699}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 20:02:31,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f9227f994ae7cf9a1fd50d077ad33ffc: 2023-09-28 20:02:31,837 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1695931351474.b322dc12642dbceccbb71430f54b1dd8., pid=93, masterSystemTime=1695931351821 2023-09-28 20:02:31,837 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1695931351474.f9227f994ae7cf9a1fd50d077ad33ffc., pid=94, masterSystemTime=1695931351821 2023-09-28 20:02:31,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1695931351474.b322dc12642dbceccbb71430f54b1dd8. 2023-09-28 20:02:31,838 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1695931351474.b322dc12642dbceccbb71430f54b1dd8. 2023-09-28 20:02:31,839 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=b322dc12642dbceccbb71430f54b1dd8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:31,839 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1695931351474.b322dc12642dbceccbb71430f54b1dd8.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695931351839"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695931351839"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695931351839"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695931351839"}]},"ts":"1695931351839"} 2023-09-28 20:02:31,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1695931351474.f9227f994ae7cf9a1fd50d077ad33ffc. 2023-09-28 20:02:31,839 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1695931351474.f9227f994ae7cf9a1fd50d077ad33ffc. 2023-09-28 20:02:31,839 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=f9227f994ae7cf9a1fd50d077ad33ffc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:31,839 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1695931351474.f9227f994ae7cf9a1fd50d077ad33ffc.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695931351839"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695931351839"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695931351839"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695931351839"}]},"ts":"1695931351839"} 2023-09-28 20:02:31,842 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=91 2023-09-28 20:02:31,842 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure b322dc12642dbceccbb71430f54b1dd8, server=jenkins-hbase4.apache.org,33091,1695931262281 in 171 msec 2023-09-28 20:02:31,842 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=92 2023-09-28 20:02:31,842 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure f9227f994ae7cf9a1fd50d077ad33ffc, server=jenkins-hbase4.apache.org,46795,1695931262192 in 171 msec 2023-09-28 20:02:31,843 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b322dc12642dbceccbb71430f54b1dd8, ASSIGN in 331 msec 2023-09-28 20:02:31,844 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=92, resume processing ppid=90 2023-09-28 20:02:31,844 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f9227f994ae7cf9a1fd50d077ad33ffc, ASSIGN in 331 msec 2023-09-28 20:02:31,844 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-28 20:02:31,844 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695931351844"}]},"ts":"1695931351844"} 2023-09-28 20:02:31,846 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-09-28 20:02:31,848 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-28 20:02:31,848 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-09-28 20:02:31,849 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33091] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-28 20:02:31,851 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 20:02:31,851 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 20:02:31,851 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 20:02:31,851 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 20:02:31,852 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-28 20:02:31,852 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-28 20:02:31,852 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-28 20:02:31,852 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-28 20:02:31,854 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 378 msec 2023-09-28 20:02:32,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-28 20:02:32,082 INFO [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-09-28 20:02:32,084 DEBUG [Listener at jenkins-hbase4.apache.org/41509] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-28 20:02:32,084 DEBUG [Listener at jenkins-hbase4.apache.org/41509] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695931351474.b322dc12642dbceccbb71430f54b1dd8. 2023-09-28 20:02:32,086 INFO [Listener at jenkins-hbase4.apache.org/41509] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-28 20:02:32,097 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-28 20:02:32,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695931352097 (current time:1695931352097). 2023-09-28 20:02:32,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-28 20:02:32,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] zookeeper.ReadOnlyZKClient(139): Connect 0x4054de56 to 127.0.0.1:50329 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 20:02:32,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b393105, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 20:02:32,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 20:02:32,113 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41712, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 20:02:32,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4054de56 to 127.0.0.1:50329 2023-09-28 20:02:32,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 20:02:32,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] zookeeper.ReadOnlyZKClient(139): Connect 0x62c09b97 to 127.0.0.1:50329 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 20:02:32,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4005ff7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 20:02:32,122 DEBUG [hconnection-0x6653f76b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 20:02:32,125 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41724, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 20:02:32,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x62c09b97 to 127.0.0.1:50329 2023-09-28 20:02:32,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 20:02:32,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-28 20:02:32,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-28 20:02:32,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-28 20:02:32,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-28 20:02:32,133 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-28 20:02:32,134 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695931952134 2023-09-28 20:02:32,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-28 20:02:32,134 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-28 20:02:32,135 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-28 20:02:32,135 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-28 20:02:32,136 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-28 20:02:32,137 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-28 20:02:32,137 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-09-28 20:02:32,140 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-28 20:02:32,141 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695931952141 2023-09-28 20:02:32,149 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,149 INFO [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-09-28 20:02:32,149 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 20:02:32,151 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-28 20:02:32,151 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-28 20:02:32,151 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,151 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,158 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:02:32,158 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:02:32,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:02:32,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:02:32,158 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:02:32,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:02:32,158 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:32,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:02:32,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:02:32,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:02:32,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,159 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:32,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,159 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:32,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,159 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,159 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,159 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:32,159 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-28 20:02:32,159 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-28 20:02:32,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-28 20:02:32,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,160 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-28 20:02:32,160 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-28 20:02:32,160 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-28 20:02:32,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,160 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-28 20:02:32,160 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,160 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-28 20:02:32,160 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-28 20:02:32,160 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 20:02:32,160 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 20:02:32,162 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,162 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-28 20:02:32,162 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-28 20:02:32,162 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 20:02:32,162 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-28 20:02:32,163 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-28 20:02:32,163 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-28 20:02:32,163 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-28 20:02:32,163 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38759,1695931262240' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-28 20:02:32,162 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-28 20:02:32,163 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46795,1695931262192' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-28 20:02:32,163 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33091,1695931262281' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-28 20:02:32,165 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:32,165 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:32,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:02:32,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:02:32,165 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,166 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:32,166 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:02:32,166 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,166 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 20:02:32,166 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,166 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 20:02:32,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:02:32,166 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,166 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 20:02:32,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:32,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:32,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:32,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:02:32,168 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46795,1695931262192' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-28 20:02:32,168 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56e9f30a[Count = 1] remaining members to acquire global barrier 2023-09-28 20:02:32,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:32,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:02:32,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:02:32,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:02:32,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:02:32,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:32,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:32,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:32,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:02:32,170 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33091,1695931262281' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-28 20:02:32,170 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56e9f30a[Count = 0] remaining members to acquire global barrier 2023-09-28 20:02:32,170 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-28 20:02:32,170 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,171 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,171 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,171 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,172 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:32,172 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-28 20:02:32,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,172 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-28 20:02:32,172 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-28 20:02:32,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,172 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38759,1695931262240' in zk 2023-09-28 20:02:32,172 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-28 20:02:32,172 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 20:02:32,172 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 20:02:32,172 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:32,172 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-28 20:02:32,172 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695931351474.b322dc12642dbceccbb71430f54b1dd8. 2023-09-28 20:02:32,172 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695931351474.b322dc12642dbceccbb71430f54b1dd8. started... 2023-09-28 20:02:32,172 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b322dc12642dbceccbb71430f54b1dd8: 2023-09-28 20:02:32,173 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695931351474.b322dc12642dbceccbb71430f54b1dd8.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,173 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 20:02:32,173 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 20:02:32,173 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 20:02:32,173 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695931351474.f9227f994ae7cf9a1fd50d077ad33ffc. 2023-09-28 20:02:32,173 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-28 20:02:32,173 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695931351474.f9227f994ae7cf9a1fd50d077ad33ffc. started... 2023-09-28 20:02:32,175 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f9227f994ae7cf9a1fd50d077ad33ffc: 2023-09-28 20:02:32,175 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695931351474.f9227f994ae7cf9a1fd50d077ad33ffc.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,175 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-28 20:02:32,175 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 20:02:32,175 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 20:02:32,175 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-28 20:02:32,175 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-28 20:02:32,185 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695931351474.b322dc12642dbceccbb71430f54b1dd8. completed. 2023-09-28 20:02:32,185 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695931351474.b322dc12642dbceccbb71430f54b1dd8. 2023-09-28 20:02:32,185 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695931351474.f9227f994ae7cf9a1fd50d077ad33ffc. completed. 2023-09-28 20:02:32,185 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 20:02:32,185 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 20:02:32,185 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:32,185 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695931351474.f9227f994ae7cf9a1fd50d077ad33ffc. 2023-09-28 20:02:32,185 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-28 20:02:32,185 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33091,1695931262281' in zk 2023-09-28 20:02:32,185 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 20:02:32,186 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 20:02:32,186 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:32,186 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-28 20:02:32,186 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46795,1695931262192' in zk 2023-09-28 20:02:32,187 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:32,187 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-28 20:02:32,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:32,187 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-28 20:02:32,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:02:32,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:02:32,187 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 20:02:32,187 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:32,187 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-28 20:02:32,187 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 20:02:32,189 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-28 20:02:32,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:02:32,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:02:32,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:32,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:32,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:32,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:02:32,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:32,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:32,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:32,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,33091,1695931262281': 2023-09-28 20:02:32,193 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33091,1695931262281' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-28 20:02:32,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:32,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:02:32,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:02:32,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:02:32,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:02:32,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:32,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:32,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:32,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:02:32,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:32,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:32,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:32,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,46795,1695931262192': 2023-09-28 20:02:32,196 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46795,1695931262192' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-28 20:02:32,196 INFO [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-09-28 20:02:32,196 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-28 20:02:32,196 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-28 20:02:32,196 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,196 INFO [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-28 20:02:32,197 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,197 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,198 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,198 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,198 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:02:32,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,198 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:02:32,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,198 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:32,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:02:32,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:02:32,198 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:02:32,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:02:32,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:02:32,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:02:32,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:02:32,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:02:32,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:02:32,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:02:32,198 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:32,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,199 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:32,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:02:32,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:32,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:32,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:32,201 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:32,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:02:32,201 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:32,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,201 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:32,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:32,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:32,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:32,204 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:32,204 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,204 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:32,204 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:32,204 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:02:32,204 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:02:32,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:02:32,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:02:32,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:02:32,204 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,204 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:02:32,204 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:32,204 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:02:32,204 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,204 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 20:02:32,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:02:32,204 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:02:32,204 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:02:32,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:02:32,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:02:32,205 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-28 20:02:32,204 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:02:32,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:02:32,206 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,206 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:32,207 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-28 20:02:32,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:02:32,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:02:32,207 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:32,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:02:32,207 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:02:32,207 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,207 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-28 20:02:32,214 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,215 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,234 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,235 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-28 20:02:32,235 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,235 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,235 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695931352134Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695931352214 (+80 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695931352214Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1695931352214Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1695931352219 (+5 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695931352228 (+9 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695931352235 (+7 ms) 2023-09-28 20:02:32,237 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 20:02:32,239 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-28 20:02:32,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-28 20:02:32,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-28 20:02:32,240 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 104 msec 2023-09-28 20:02:32,242 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1695931351474.b322dc12642dbceccbb71430f54b1dd8. with WAL disabled. Data may be lost in the event of a crash. 2023-09-28 20:02:32,243 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46795] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1695931351474.f9227f994ae7cf9a1fd50d077ad33ffc. with WAL disabled. Data may be lost in the event of a crash. 2023-09-28 20:02:32,245 DEBUG [Listener at jenkins-hbase4.apache.org/41509] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-28 20:02:32,246 DEBUG [Listener at jenkins-hbase4.apache.org/41509] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695931351474.b322dc12642dbceccbb71430f54b1dd8. 2023-09-28 20:02:32,246 INFO [Listener at jenkins-hbase4.apache.org/41509] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-28 20:02:32,256 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-28 20:02:32,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695931352256 (current time:1695931352256). 2023-09-28 20:02:32,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-28 20:02:32,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] zookeeper.ReadOnlyZKClient(139): Connect 0x29eaa5bd to 127.0.0.1:50329 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 20:02:32,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@507bf744, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 20:02:32,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 20:02:32,267 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41734, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 20:02:32,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x29eaa5bd to 127.0.0.1:50329 2023-09-28 20:02:32,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 20:02:32,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] zookeeper.ReadOnlyZKClient(139): Connect 0x67824780 to 127.0.0.1:50329 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 20:02:32,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1bb9c180, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 20:02:32,278 DEBUG [hconnection-0x1477c464-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 20:02:32,281 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41750, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 20:02:32,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x67824780 to 127.0.0.1:50329 2023-09-28 20:02:32,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 20:02:32,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-28 20:02:32,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-28 20:02:32,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-28 20:02:32,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-28 20:02:32,291 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-28 20:02:32,292 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695931952292 2023-09-28 20:02:32,292 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-28 20:02:32,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-28 20:02:32,294 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-28 20:02:32,294 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-28 20:02:32,295 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-28 20:02:32,295 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-28 20:02:32,296 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-09-28 20:02:32,297 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-28 20:02:32,298 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695931952298 2023-09-28 20:02:32,310 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,310 INFO [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-09-28 20:02:32,310 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 20:02:32,311 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-28 20:02:32,311 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-28 20:02:32,312 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,312 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,314 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:02:32,314 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:02:32,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:02:32,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:02:32,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:02:32,314 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:02:32,314 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:32,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:02:32,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:02:32,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:02:32,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,315 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:32,315 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:32,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,315 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,315 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:32,315 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,315 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,315 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-28 20:02:32,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-28 20:02:32,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,315 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-28 20:02:32,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-28 20:02:32,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-28 20:02:32,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,316 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,316 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-28 20:02:32,316 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-28 20:02:32,316 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-28 20:02:32,316 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 20:02:32,316 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,317 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-28 20:02:32,318 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-28 20:02:32,318 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-28 20:02:32,317 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,319 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 20:02:32,319 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-28 20:02:32,318 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33091,1695931262281' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-28 20:02:32,320 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-28 20:02:32,320 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-28 20:02:32,319 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 20:02:32,320 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38759,1695931262240' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-28 20:02:32,323 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-28 20:02:32,323 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-28 20:02:32,323 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46795,1695931262192' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-28 20:02:32,324 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:32,324 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:32,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:02:32,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:02:32,324 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,325 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:32,325 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,325 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,325 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 20:02:32,325 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,325 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 20:02:32,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:02:32,325 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,326 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 20:02:32,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:02:32,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:32,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:32,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:32,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:02:32,327 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33091,1695931262281' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-28 20:02:32,327 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5bcf0f3b[Count = 1] remaining members to acquire global barrier 2023-09-28 20:02:32,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:32,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:02:32,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:02:32,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:02:32,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:02:32,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:32,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:32,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:32,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:02:32,329 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46795,1695931262192' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-28 20:02:32,329 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5bcf0f3b[Count = 0] remaining members to acquire global barrier 2023-09-28 20:02:32,329 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-28 20:02:32,329 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,334 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,334 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,334 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,335 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:32,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,335 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-28 20:02:32,335 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-28 20:02:32,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,335 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:32,335 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-28 20:02:32,335 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 20:02:32,335 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 20:02:32,335 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695931351474.b322dc12642dbceccbb71430f54b1dd8. 2023-09-28 20:02:32,335 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-28 20:02:32,335 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695931351474.b322dc12642dbceccbb71430f54b1dd8. started... 2023-09-28 20:02:32,335 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695931351474.f9227f994ae7cf9a1fd50d077ad33ffc. 2023-09-28 20:02:32,335 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-28 20:02:32,335 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695931351474.f9227f994ae7cf9a1fd50d077ad33ffc. started... 2023-09-28 20:02:32,335 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38759,1695931262240' in zk 2023-09-28 20:02:32,335 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 20:02:32,335 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 20:02:32,335 INFO [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b322dc12642dbceccbb71430f54b1dd8 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-28 20:02:32,336 INFO [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f9227f994ae7cf9a1fd50d077ad33ffc 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-28 20:02:32,337 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-28 20:02:32,337 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 20:02:32,337 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-28 20:02:32,362 INFO [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230928db363fe1f7274bfa808a0599dc420fc9 to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230928db363fe1f7274bfa808a0599dc420fc9 2023-09-28 20:02:32,364 INFO [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309283f677658a0d34dcda1feabdde649abc6 to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309283f677658a0d34dcda1feabdde649abc6 2023-09-28 20:02:32,376 INFO [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testEmptyExportFileSystemState/f9227f994ae7cf9a1fd50d077ad33ffc/.tmp/cf/30c4ba4aecc84e668891e81560ea64fd 2023-09-28 20:02:32,376 INFO [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testEmptyExportFileSystemState/b322dc12642dbceccbb71430f54b1dd8/.tmp/cf/5364aec0c1cb4238bf1c4aad7dbbef07 2023-09-28 20:02:32,383 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testEmptyExportFileSystemState/f9227f994ae7cf9a1fd50d077ad33ffc/.tmp/cf/30c4ba4aecc84e668891e81560ea64fd as hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testEmptyExportFileSystemState/f9227f994ae7cf9a1fd50d077ad33ffc/cf/30c4ba4aecc84e668891e81560ea64fd 2023-09-28 20:02:32,383 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testEmptyExportFileSystemState/b322dc12642dbceccbb71430f54b1dd8/.tmp/cf/5364aec0c1cb4238bf1c4aad7dbbef07 as hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testEmptyExportFileSystemState/b322dc12642dbceccbb71430f54b1dd8/cf/5364aec0c1cb4238bf1c4aad7dbbef07 2023-09-28 20:02:32,389 INFO [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testEmptyExportFileSystemState/f9227f994ae7cf9a1fd50d077ad33ffc/cf/30c4ba4aecc84e668891e81560ea64fd, entries=46, sequenceid=6, filesize=12.9 K 2023-09-28 20:02:32,389 INFO [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testEmptyExportFileSystemState/b322dc12642dbceccbb71430f54b1dd8/cf/5364aec0c1cb4238bf1c4aad7dbbef07, entries=4, sequenceid=6, filesize=5.6 K 2023-09-28 20:02:32,390 INFO [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for b322dc12642dbceccbb71430f54b1dd8 in 55ms, sequenceid=6, compaction requested=false 2023-09-28 20:02:32,390 INFO [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for f9227f994ae7cf9a1fd50d077ad33ffc in 55ms, sequenceid=6, compaction requested=false 2023-09-28 20:02:32,390 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-28 20:02:32,390 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-28 20:02:32,393 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b322dc12642dbceccbb71430f54b1dd8: 2023-09-28 20:02:32,393 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f9227f994ae7cf9a1fd50d077ad33ffc: 2023-09-28 20:02:32,393 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695931351474.f9227f994ae7cf9a1fd50d077ad33ffc.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,393 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695931351474.b322dc12642dbceccbb71430f54b1dd8.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,394 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 20:02:32,394 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 20:02:32,394 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testEmptyExportFileSystemState/f9227f994ae7cf9a1fd50d077ad33ffc/cf/30c4ba4aecc84e668891e81560ea64fd] hfiles 2023-09-28 20:02:32,394 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 20:02:32,394 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testEmptyExportFileSystemState/f9227f994ae7cf9a1fd50d077ad33ffc/cf/30c4ba4aecc84e668891e81560ea64fd for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,394 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testEmptyExportFileSystemState/b322dc12642dbceccbb71430f54b1dd8/cf/5364aec0c1cb4238bf1c4aad7dbbef07] hfiles 2023-09-28 20:02:32,395 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testEmptyExportFileSystemState/b322dc12642dbceccbb71430f54b1dd8/cf/5364aec0c1cb4238bf1c4aad7dbbef07 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-28 20:02:32,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-28 20:02:32,396 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-28 20:02:32,409 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695931351474.f9227f994ae7cf9a1fd50d077ad33ffc. completed. 2023-09-28 20:02:32,409 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695931351474.f9227f994ae7cf9a1fd50d077ad33ffc. 2023-09-28 20:02:32,409 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 20:02:32,409 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 20:02:32,409 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:32,409 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-28 20:02:32,409 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46795,1695931262192' in zk 2023-09-28 20:02:32,411 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695931351474.b322dc12642dbceccbb71430f54b1dd8. completed. 2023-09-28 20:02:32,411 DEBUG [rs(jenkins-hbase4.apache.org,33091,1695931262281)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695931351474.b322dc12642dbceccbb71430f54b1dd8. 2023-09-28 20:02:32,411 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 20:02:32,411 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 20:02:32,411 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:32,411 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-28 20:02:32,411 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33091,1695931262281' in zk 2023-09-28 20:02:32,411 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:32,411 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-28 20:02:32,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:32,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:02:32,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:02:32,411 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 20:02:32,411 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-28 20:02:32,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:02:32,414 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:32,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:02:32,414 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-28 20:02:32,414 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 20:02:32,414 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-28 20:02:32,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:32,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:32,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:32,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:02:32,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:32,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:32,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:32,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,46795,1695931262192': 2023-09-28 20:02:32,418 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46795,1695931262192' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-28 20:02:32,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:32,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:02:32,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:02:32,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:02:32,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:02:32,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:32,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:32,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:32,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:02:32,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:32,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:32,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:32,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,33091,1695931262281': 2023-09-28 20:02:32,423 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33091,1695931262281' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-28 20:02:32,423 INFO [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-09-28 20:02:32,423 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-28 20:02:32,423 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-28 20:02:32,423 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,423 INFO [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-28 20:02:32,426 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,426 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,426 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:02:32,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:02:32,426 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:02:32,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,426 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:02:32,426 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,426 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:02:32,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:02:32,426 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:32,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:02:32,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:02:32,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:02:32,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:02:32,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,427 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:32,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:02:32,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:02:32,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:02:32,427 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:32,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:32,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:32,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:32,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:02:32,429 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:32,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,429 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:32,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:32,429 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:32,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:32,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:32,432 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:32,432 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,432 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:32,432 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:32,432 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,432 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:02:32,432 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:02:32,432 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:02:32,432 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:02:32,432 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,432 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:02:32,432 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-28 20:02:32,432 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:02:32,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:02:32,432 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,432 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 20:02:32,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:02:32,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:02:32,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:02:32,432 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:32,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:02:32,434 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,432 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-28 20:02:32,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:02:32,434 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:32,434 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:32,434 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,434 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:02:32,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:02:32,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:02:32,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:02:32,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:02:32,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:02:32,435 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309283f677658a0d34dcda1feabdde649abc6, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230928db363fe1f7274bfa808a0599dc420fc9] mob files 2023-09-28 20:02:32,435 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309283f677658a0d34dcda1feabdde649abc6 2023-09-28 20:02:32,435 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230928db363fe1f7274bfa808a0599dc420fc9 2023-09-28 20:02:32,442 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,443 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,465 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,466 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-28 20:02:32,466 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,466 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,466 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695931352292Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695931352442 (+150 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1695931352442Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1695931352442Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1695931352447 (+5 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1695931352458 (+11 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695931352466 (+8 ms) 2023-09-28 20:02:32,471 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-28 20:02:32,473 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 178 msec 2023-09-28 20:02:32,596 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 20:02:32,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-28 20:02:32,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-28 20:02:32,597 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/export-test/export-1695931352597 2023-09-28 20:02:32,598 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43143, tgtDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/export-test/export-1695931352597, rawTgtDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/export-test/export-1695931352597, srcFsUri=hdfs://localhost:43143, srcDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff 2023-09-28 20:02:32,647 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43143, inputRoot=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff 2023-09-28 20:02:32,647 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_562778797_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/export-test/export-1695931352597, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/export-test/export-1695931352597/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,647 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43143, inputRoot=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff, snapshotDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-09-28 20:02:32,653 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/export-test/export-1695931352597/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:32,671 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-28 20:02:32,671 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-28 20:02:32,672 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-28 20:02:32,672 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-28 20:02:33,545 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/hadoop-6802080994775454491.jar 2023-09-28 20:02:33,545 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-28 20:02:33,546 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-28 20:02:33,616 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/hadoop-4995273426687938924.jar 2023-09-28 20:02:33,616 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-28 20:02:33,616 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-28 20:02:33,617 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-28 20:02:33,617 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-28 20:02:33,617 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-28 20:02:33,618 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-28 20:02:33,618 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-28 20:02:33,618 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-28 20:02:33,619 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-28 20:02:33,619 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-28 20:02:33,619 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-28 20:02:33,620 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-28 20:02:33,620 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-28 20:02:33,620 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-28 20:02:33,621 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-28 20:02:33,621 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-28 20:02:33,622 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 20:02:33,622 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 20:02:33,623 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 20:02:33,623 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 20:02:33,623 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 20:02:33,624 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 20:02:33,624 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 20:02:33,983 WARN [Listener at jenkins-hbase4.apache.org/41509] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-28 20:02:33,985 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-09-28 20:02:34,733 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 20:02:34,733 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 20:02:34,736 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695931268848_0005_000001 (auth:SIMPLE) 2023-09-28 20:02:35,252 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695931268848_0006_000001 (auth:SIMPLE) 2023-09-28 20:02:36,337 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-28 20:02:39,052 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695931268848_0006_000001 (auth:SIMPLE) 2023-09-28 20:02:41,333 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-28 20:02:41,334 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-28 20:02:41,339 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:41,339 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-28 20:02:41,340 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-28 20:02:41,340 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_394157282_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:41,340 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(367): hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-28 20:02:41,340 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(367): hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-28 20:02:41,340 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_394157282_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/export-test/export-1695931352597/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/export-test/export-1695931352597/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:41,341 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(367): hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/export-test/export-1695931352597/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-28 20:02:41,341 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(367): hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/export-test/export-1695931352597/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-28 20:02:41,346 INFO [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-09-28 20:02:41,347 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-09-28 20:02:41,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-28 20:02:41,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-28 20:02:41,351 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695931361351"}]},"ts":"1695931361351"} 2023-09-28 20:02:41,353 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-09-28 20:02:41,354 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-09-28 20:02:41,355 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b322dc12642dbceccbb71430f54b1dd8, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f9227f994ae7cf9a1fd50d077ad33ffc, UNASSIGN}] 2023-09-28 20:02:41,357 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f9227f994ae7cf9a1fd50d077ad33ffc, UNASSIGN 2023-09-28 20:02:41,357 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b322dc12642dbceccbb71430f54b1dd8, UNASSIGN 2023-09-28 20:02:41,358 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=f9227f994ae7cf9a1fd50d077ad33ffc, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:41,358 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695931351474.f9227f994ae7cf9a1fd50d077ad33ffc.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695931361358"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695931361358"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695931361358"}]},"ts":"1695931361358"} 2023-09-28 20:02:41,358 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=b322dc12642dbceccbb71430f54b1dd8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:41,359 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695931351474.b322dc12642dbceccbb71430f54b1dd8.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695931361358"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695931361358"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695931361358"}]},"ts":"1695931361358"} 2023-09-28 20:02:41,360 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure f9227f994ae7cf9a1fd50d077ad33ffc, server=jenkins-hbase4.apache.org,46795,1695931262192}] 2023-09-28 20:02:41,360 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure b322dc12642dbceccbb71430f54b1dd8, server=jenkins-hbase4.apache.org,33091,1695931262281}] 2023-09-28 20:02:41,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-28 20:02:41,512 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f9227f994ae7cf9a1fd50d077ad33ffc 2023-09-28 20:02:41,512 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f9227f994ae7cf9a1fd50d077ad33ffc, disabling compactions & flushes 2023-09-28 20:02:41,512 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695931351474.f9227f994ae7cf9a1fd50d077ad33ffc. 2023-09-28 20:02:41,512 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695931351474.f9227f994ae7cf9a1fd50d077ad33ffc. 2023-09-28 20:02:41,512 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695931351474.f9227f994ae7cf9a1fd50d077ad33ffc. after waiting 0 ms 2023-09-28 20:02:41,512 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695931351474.f9227f994ae7cf9a1fd50d077ad33ffc. 2023-09-28 20:02:41,513 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b322dc12642dbceccbb71430f54b1dd8 2023-09-28 20:02:41,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b322dc12642dbceccbb71430f54b1dd8, disabling compactions & flushes 2023-09-28 20:02:41,516 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695931351474.b322dc12642dbceccbb71430f54b1dd8. 2023-09-28 20:02:41,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695931351474.b322dc12642dbceccbb71430f54b1dd8. 2023-09-28 20:02:41,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695931351474.b322dc12642dbceccbb71430f54b1dd8. after waiting 0 ms 2023-09-28 20:02:41,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695931351474.b322dc12642dbceccbb71430f54b1dd8. 2023-09-28 20:02:41,522 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testEmptyExportFileSystemState/f9227f994ae7cf9a1fd50d077ad33ffc/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-28 20:02:41,522 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testEmptyExportFileSystemState/b322dc12642dbceccbb71430f54b1dd8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-28 20:02:41,523 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 20:02:41,523 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 20:02:41,524 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695931351474.f9227f994ae7cf9a1fd50d077ad33ffc. 2023-09-28 20:02:41,524 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f9227f994ae7cf9a1fd50d077ad33ffc: 2023-09-28 20:02:41,524 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695931351474.b322dc12642dbceccbb71430f54b1dd8. 2023-09-28 20:02:41,525 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b322dc12642dbceccbb71430f54b1dd8: 2023-09-28 20:02:41,526 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f9227f994ae7cf9a1fd50d077ad33ffc 2023-09-28 20:02:41,526 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=f9227f994ae7cf9a1fd50d077ad33ffc, regionState=CLOSED 2023-09-28 20:02:41,527 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695931351474.f9227f994ae7cf9a1fd50d077ad33ffc.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695931361526"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695931361526"}]},"ts":"1695931361526"} 2023-09-28 20:02:41,527 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b322dc12642dbceccbb71430f54b1dd8 2023-09-28 20:02:41,527 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=b322dc12642dbceccbb71430f54b1dd8, regionState=CLOSED 2023-09-28 20:02:41,527 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695931351474.b322dc12642dbceccbb71430f54b1dd8.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695931361527"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695931361527"}]},"ts":"1695931361527"} 2023-09-28 20:02:41,529 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=101 2023-09-28 20:02:41,529 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure f9227f994ae7cf9a1fd50d077ad33ffc, server=jenkins-hbase4.apache.org,46795,1695931262192 in 168 msec 2023-09-28 20:02:41,530 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=100 2023-09-28 20:02:41,530 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure b322dc12642dbceccbb71430f54b1dd8, server=jenkins-hbase4.apache.org,33091,1695931262281 in 169 msec 2023-09-28 20:02:41,530 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f9227f994ae7cf9a1fd50d077ad33ffc, UNASSIGN in 174 msec 2023-09-28 20:02:41,531 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=100, resume processing ppid=99 2023-09-28 20:02:41,531 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b322dc12642dbceccbb71430f54b1dd8, UNASSIGN in 175 msec 2023-09-28 20:02:41,532 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695931361532"}]},"ts":"1695931361532"} 2023-09-28 20:02:41,534 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-09-28 20:02:41,536 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-09-28 20:02:41,537 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 189 msec 2023-09-28 20:02:41,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-28 20:02:41,654 INFO [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-09-28 20:02:41,654 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-09-28 20:02:41,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-28 20:02:41,658 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-28 20:02:41,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-09-28 20:02:41,658 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-28 20:02:41,660 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33091] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-09-28 20:02:41,663 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testEmptyExportFileSystemState/b322dc12642dbceccbb71430f54b1dd8 2023-09-28 20:02:41,663 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testEmptyExportFileSystemState/f9227f994ae7cf9a1fd50d077ad33ffc 2023-09-28 20:02:41,664 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-28 20:02:41,664 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-28 20:02:41,664 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-28 20:02:41,664 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-28 20:02:41,664 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-28 20:02:41,664 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-28 20:02:41,664 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-28 20:02:41,664 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-28 20:02:41,665 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testEmptyExportFileSystemState/b322dc12642dbceccbb71430f54b1dd8/cf, FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testEmptyExportFileSystemState/b322dc12642dbceccbb71430f54b1dd8/recovered.edits] 2023-09-28 20:02:41,665 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testEmptyExportFileSystemState/f9227f994ae7cf9a1fd50d077ad33ffc/cf, FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testEmptyExportFileSystemState/f9227f994ae7cf9a1fd50d077ad33ffc/recovered.edits] 2023-09-28 20:02:41,665 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-28 20:02:41,665 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-28 20:02:41,665 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 20:02:41,665 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-28 20:02:41,665 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 20:02:41,665 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-28 20:02:41,665 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 20:02:41,665 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 20:02:41,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-28 20:02:41,669 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testEmptyExportFileSystemState/b322dc12642dbceccbb71430f54b1dd8/cf/5364aec0c1cb4238bf1c4aad7dbbef07 to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/archive/data/default/testtb-testEmptyExportFileSystemState/b322dc12642dbceccbb71430f54b1dd8/cf/5364aec0c1cb4238bf1c4aad7dbbef07 2023-09-28 20:02:41,669 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testEmptyExportFileSystemState/f9227f994ae7cf9a1fd50d077ad33ffc/cf/30c4ba4aecc84e668891e81560ea64fd to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/archive/data/default/testtb-testEmptyExportFileSystemState/f9227f994ae7cf9a1fd50d077ad33ffc/cf/30c4ba4aecc84e668891e81560ea64fd 2023-09-28 20:02:41,671 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testEmptyExportFileSystemState/f9227f994ae7cf9a1fd50d077ad33ffc/recovered.edits/9.seqid to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/archive/data/default/testtb-testEmptyExportFileSystemState/f9227f994ae7cf9a1fd50d077ad33ffc/recovered.edits/9.seqid 2023-09-28 20:02:41,672 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testEmptyExportFileSystemState/b322dc12642dbceccbb71430f54b1dd8/recovered.edits/9.seqid to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/archive/data/default/testtb-testEmptyExportFileSystemState/b322dc12642dbceccbb71430f54b1dd8/recovered.edits/9.seqid 2023-09-28 20:02:41,672 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testEmptyExportFileSystemState/f9227f994ae7cf9a1fd50d077ad33ffc 2023-09-28 20:02:41,672 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testEmptyExportFileSystemState/b322dc12642dbceccbb71430f54b1dd8 2023-09-28 20:02:41,672 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-28 20:02:41,673 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-28 20:02:41,674 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-09-28 20:02:41,677 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309283f677658a0d34dcda1feabdde649abc6 to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309283f677658a0d34dcda1feabdde649abc6 2023-09-28 20:02:41,678 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230928db363fe1f7274bfa808a0599dc420fc9 to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230928db363fe1f7274bfa808a0599dc420fc9 2023-09-28 20:02:41,679 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-28 20:02:41,681 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-28 20:02:41,683 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-09-28 20:02:41,685 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-09-28 20:02:41,686 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-28 20:02:41,686 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-09-28 20:02:41,686 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1695931351474.b322dc12642dbceccbb71430f54b1dd8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695931361686"}]},"ts":"9223372036854775807"} 2023-09-28 20:02:41,686 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1695931351474.f9227f994ae7cf9a1fd50d077ad33ffc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695931361686"}]},"ts":"9223372036854775807"} 2023-09-28 20:02:41,688 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-28 20:02:41,688 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b322dc12642dbceccbb71430f54b1dd8, NAME => 'testtb-testEmptyExportFileSystemState,,1695931351474.b322dc12642dbceccbb71430f54b1dd8.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => f9227f994ae7cf9a1fd50d077ad33ffc, NAME => 'testtb-testEmptyExportFileSystemState,1,1695931351474.f9227f994ae7cf9a1fd50d077ad33ffc.', STARTKEY => '1', ENDKEY => ''}] 2023-09-28 20:02:41,688 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-09-28 20:02:41,688 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695931361688"}]},"ts":"9223372036854775807"} 2023-09-28 20:02:41,690 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-09-28 20:02:41,692 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-28 20:02:41,693 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 38 msec 2023-09-28 20:02:41,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-28 20:02:41,767 INFO [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-09-28 20:02:41,774 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-09-28 20:02:41,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:41,778 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-09-28 20:02:41,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-09-28 20:02:41,805 INFO [Listener at jenkins-hbase4.apache.org/41509] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=764 (was 757) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:41509 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_394157282_17 at /127.0.0.1:46126 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:37079 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x1dd01c2f-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1dd01c2f-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1dd01c2f-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:44245 from appattempt_1695931268848_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Thread-4611 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_635773607_1 at /127.0.0.1:46068 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:36805 from appattempt_1695931268848_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x1dd01c2f-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_394157282_17 at /127.0.0.1:39914 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=938 (was 908) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=190 (was 206), ProcessCount=168 (was 168), AvailableMemoryMB=4532 (was 4554) 2023-09-28 20:02:41,805 WARN [Listener at jenkins-hbase4.apache.org/41509] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-09-28 20:02:41,826 INFO [Listener at jenkins-hbase4.apache.org/41509] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=764, OpenFileDescriptor=938, MaxFileDescriptor=60000, SystemLoadAverage=190, ProcessCount=168, AvailableMemoryMB=4532 2023-09-28 20:02:41,826 WARN [Listener at jenkins-hbase4.apache.org/41509] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-09-28 20:02:41,828 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-28 20:02:41,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:41,831 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-09-28 20:02:41,831 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-09-28 20:02:41,832 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-28 20:02:41,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-28 20:02:41,834 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b24d449a79789a1b6d51da3725ba0d46 2023-09-28 20:02:41,834 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/11f74eed96fdac452b526f8efc696a36 2023-09-28 20:02:41,835 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b24d449a79789a1b6d51da3725ba0d46 empty. 2023-09-28 20:02:41,835 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/11f74eed96fdac452b526f8efc696a36 empty. 2023-09-28 20:02:41,835 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b24d449a79789a1b6d51da3725ba0d46 2023-09-28 20:02:41,835 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/11f74eed96fdac452b526f8efc696a36 2023-09-28 20:02:41,835 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-28 20:02:41,845 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-09-28 20:02:41,846 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => b24d449a79789a1b6d51da3725ba0d46, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695931361827.b24d449a79789a1b6d51da3725ba0d46.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp 2023-09-28 20:02:41,846 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 11f74eed96fdac452b526f8efc696a36, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695931361827.11f74eed96fdac452b526f8efc696a36.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp 2023-09-28 20:02:41,865 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695931361827.b24d449a79789a1b6d51da3725ba0d46.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 20:02:41,865 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing b24d449a79789a1b6d51da3725ba0d46, disabling compactions & flushes 2023-09-28 20:02:41,865 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695931361827.b24d449a79789a1b6d51da3725ba0d46. 2023-09-28 20:02:41,865 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695931361827.b24d449a79789a1b6d51da3725ba0d46. 2023-09-28 20:02:41,865 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695931361827.b24d449a79789a1b6d51da3725ba0d46. after waiting 0 ms 2023-09-28 20:02:41,865 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695931361827.b24d449a79789a1b6d51da3725ba0d46. 2023-09-28 20:02:41,866 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695931361827.b24d449a79789a1b6d51da3725ba0d46. 2023-09-28 20:02:41,866 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for b24d449a79789a1b6d51da3725ba0d46: 2023-09-28 20:02:41,867 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695931361827.11f74eed96fdac452b526f8efc696a36.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 20:02:41,867 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 11f74eed96fdac452b526f8efc696a36, disabling compactions & flushes 2023-09-28 20:02:41,868 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695931361827.11f74eed96fdac452b526f8efc696a36. 2023-09-28 20:02:41,868 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695931361827.11f74eed96fdac452b526f8efc696a36. 2023-09-28 20:02:41,868 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695931361827.11f74eed96fdac452b526f8efc696a36. after waiting 0 ms 2023-09-28 20:02:41,868 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695931361827.11f74eed96fdac452b526f8efc696a36. 2023-09-28 20:02:41,868 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695931361827.11f74eed96fdac452b526f8efc696a36. 2023-09-28 20:02:41,868 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 11f74eed96fdac452b526f8efc696a36: 2023-09-28 20:02:41,870 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-09-28 20:02:41,871 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695931361827.b24d449a79789a1b6d51da3725ba0d46.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695931361871"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695931361871"}]},"ts":"1695931361871"} 2023-09-28 20:02:41,871 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695931361827.11f74eed96fdac452b526f8efc696a36.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695931361871"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695931361871"}]},"ts":"1695931361871"} 2023-09-28 20:02:41,873 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-28 20:02:41,874 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-28 20:02:41,874 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695931361874"}]},"ts":"1695931361874"} 2023-09-28 20:02:41,875 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-09-28 20:02:41,878 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-28 20:02:41,879 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-28 20:02:41,879 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-28 20:02:41,879 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-28 20:02:41,879 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-28 20:02:41,880 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b24d449a79789a1b6d51da3725ba0d46, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=11f74eed96fdac452b526f8efc696a36, ASSIGN}] 2023-09-28 20:02:41,882 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b24d449a79789a1b6d51da3725ba0d46, ASSIGN 2023-09-28 20:02:41,882 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=11f74eed96fdac452b526f8efc696a36, ASSIGN 2023-09-28 20:02:41,883 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b24d449a79789a1b6d51da3725ba0d46, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38759,1695931262240; forceNewPlan=false, retain=false 2023-09-28 20:02:41,883 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=11f74eed96fdac452b526f8efc696a36, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46795,1695931262192; forceNewPlan=false, retain=false 2023-09-28 20:02:41,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-28 20:02:42,033 INFO [jenkins-hbase4:35173] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-28 20:02:42,036 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=11f74eed96fdac452b526f8efc696a36, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:42,036 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=b24d449a79789a1b6d51da3725ba0d46, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:42,036 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695931361827.11f74eed96fdac452b526f8efc696a36.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695931362036"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695931362036"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695931362036"}]},"ts":"1695931362036"} 2023-09-28 20:02:42,036 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695931361827.b24d449a79789a1b6d51da3725ba0d46.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695931362036"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695931362036"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695931362036"}]},"ts":"1695931362036"} 2023-09-28 20:02:42,038 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure 11f74eed96fdac452b526f8efc696a36, server=jenkins-hbase4.apache.org,46795,1695931262192}] 2023-09-28 20:02:42,039 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure b24d449a79789a1b6d51da3725ba0d46, server=jenkins-hbase4.apache.org,38759,1695931262240}] 2023-09-28 20:02:42,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-28 20:02:42,194 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1695931361827.b24d449a79789a1b6d51da3725ba0d46. 2023-09-28 20:02:42,194 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1695931361827.11f74eed96fdac452b526f8efc696a36. 2023-09-28 20:02:42,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b24d449a79789a1b6d51da3725ba0d46, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695931361827.b24d449a79789a1b6d51da3725ba0d46.', STARTKEY => '', ENDKEY => '1'} 2023-09-28 20:02:42,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 11f74eed96fdac452b526f8efc696a36, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695931361827.11f74eed96fdac452b526f8efc696a36.', STARTKEY => '1', ENDKEY => ''} 2023-09-28 20:02:42,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1695931361827.b24d449a79789a1b6d51da3725ba0d46. service=AccessControlService 2023-09-28 20:02:42,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1695931361827.11f74eed96fdac452b526f8efc696a36. service=AccessControlService 2023-09-28 20:02:42,195 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 20:02:42,195 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 20:02:42,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 11f74eed96fdac452b526f8efc696a36 2023-09-28 20:02:42,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp b24d449a79789a1b6d51da3725ba0d46 2023-09-28 20:02:42,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695931361827.11f74eed96fdac452b526f8efc696a36.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 20:02:42,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695931361827.b24d449a79789a1b6d51da3725ba0d46.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 20:02:42,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 11f74eed96fdac452b526f8efc696a36 2023-09-28 20:02:42,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b24d449a79789a1b6d51da3725ba0d46 2023-09-28 20:02:42,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 11f74eed96fdac452b526f8efc696a36 2023-09-28 20:02:42,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b24d449a79789a1b6d51da3725ba0d46 2023-09-28 20:02:42,196 INFO [StoreOpener-b24d449a79789a1b6d51da3725ba0d46-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b24d449a79789a1b6d51da3725ba0d46 2023-09-28 20:02:42,197 INFO [StoreOpener-11f74eed96fdac452b526f8efc696a36-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 11f74eed96fdac452b526f8efc696a36 2023-09-28 20:02:42,198 DEBUG [StoreOpener-b24d449a79789a1b6d51da3725ba0d46-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithSkipTmp/b24d449a79789a1b6d51da3725ba0d46/cf 2023-09-28 20:02:42,198 DEBUG [StoreOpener-11f74eed96fdac452b526f8efc696a36-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithSkipTmp/11f74eed96fdac452b526f8efc696a36/cf 2023-09-28 20:02:42,198 DEBUG [StoreOpener-11f74eed96fdac452b526f8efc696a36-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithSkipTmp/11f74eed96fdac452b526f8efc696a36/cf 2023-09-28 20:02:42,198 DEBUG [StoreOpener-b24d449a79789a1b6d51da3725ba0d46-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithSkipTmp/b24d449a79789a1b6d51da3725ba0d46/cf 2023-09-28 20:02:42,198 INFO [StoreOpener-b24d449a79789a1b6d51da3725ba0d46-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b24d449a79789a1b6d51da3725ba0d46 columnFamilyName cf 2023-09-28 20:02:42,198 INFO [StoreOpener-11f74eed96fdac452b526f8efc696a36-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 11f74eed96fdac452b526f8efc696a36 columnFamilyName cf 2023-09-28 20:02:42,200 INFO [StoreOpener-b24d449a79789a1b6d51da3725ba0d46-1] regionserver.HStore(310): Store=b24d449a79789a1b6d51da3725ba0d46/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 20:02:42,200 INFO [StoreOpener-11f74eed96fdac452b526f8efc696a36-1] regionserver.HStore(310): Store=11f74eed96fdac452b526f8efc696a36/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 20:02:42,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithSkipTmp/b24d449a79789a1b6d51da3725ba0d46 2023-09-28 20:02:42,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithSkipTmp/11f74eed96fdac452b526f8efc696a36 2023-09-28 20:02:42,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithSkipTmp/b24d449a79789a1b6d51da3725ba0d46 2023-09-28 20:02:42,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithSkipTmp/11f74eed96fdac452b526f8efc696a36 2023-09-28 20:02:42,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 11f74eed96fdac452b526f8efc696a36 2023-09-28 20:02:42,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b24d449a79789a1b6d51da3725ba0d46 2023-09-28 20:02:42,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithSkipTmp/11f74eed96fdac452b526f8efc696a36/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 20:02:42,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithSkipTmp/b24d449a79789a1b6d51da3725ba0d46/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 20:02:42,206 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 11f74eed96fdac452b526f8efc696a36; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64825176, jitterRate=-0.034029603004455566}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 20:02:42,206 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b24d449a79789a1b6d51da3725ba0d46; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70416448, jitterRate=0.049286842346191406}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 20:02:42,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 11f74eed96fdac452b526f8efc696a36: 2023-09-28 20:02:42,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b24d449a79789a1b6d51da3725ba0d46: 2023-09-28 20:02:42,209 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1695931361827.11f74eed96fdac452b526f8efc696a36., pid=108, masterSystemTime=1695931362190 2023-09-28 20:02:42,209 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1695931361827.b24d449a79789a1b6d51da3725ba0d46., pid=109, masterSystemTime=1695931362190 2023-09-28 20:02:42,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1695931361827.11f74eed96fdac452b526f8efc696a36. 2023-09-28 20:02:42,210 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1695931361827.11f74eed96fdac452b526f8efc696a36. 2023-09-28 20:02:42,211 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=11f74eed96fdac452b526f8efc696a36, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:42,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1695931361827.b24d449a79789a1b6d51da3725ba0d46. 2023-09-28 20:02:42,211 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1695931361827.b24d449a79789a1b6d51da3725ba0d46. 2023-09-28 20:02:42,211 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695931361827.11f74eed96fdac452b526f8efc696a36.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695931362211"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695931362211"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695931362211"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695931362211"}]},"ts":"1695931362211"} 2023-09-28 20:02:42,211 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=b24d449a79789a1b6d51da3725ba0d46, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:42,211 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695931361827.b24d449a79789a1b6d51da3725ba0d46.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695931362211"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695931362211"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695931362211"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695931362211"}]},"ts":"1695931362211"} 2023-09-28 20:02:42,214 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=107 2023-09-28 20:02:42,214 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure 11f74eed96fdac452b526f8efc696a36, server=jenkins-hbase4.apache.org,46795,1695931262192 in 174 msec 2023-09-28 20:02:42,214 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=106 2023-09-28 20:02:42,214 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure b24d449a79789a1b6d51da3725ba0d46, server=jenkins-hbase4.apache.org,38759,1695931262240 in 174 msec 2023-09-28 20:02:42,215 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=11f74eed96fdac452b526f8efc696a36, ASSIGN in 334 msec 2023-09-28 20:02:42,216 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=106, resume processing ppid=105 2023-09-28 20:02:42,216 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b24d449a79789a1b6d51da3725ba0d46, ASSIGN in 334 msec 2023-09-28 20:02:42,216 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-28 20:02:42,217 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695931362217"}]},"ts":"1695931362217"} 2023-09-28 20:02:42,218 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-09-28 20:02:42,220 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-09-28 20:02:42,220 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-09-28 20:02:42,221 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33091] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-28 20:02:42,224 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 20:02:42,224 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 20:02:42,224 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 20:02:42,224 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 20:02:42,225 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-28 20:02:42,226 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-28 20:02:42,226 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-28 20:02:42,225 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-28 20:02:42,227 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 398 msec 2023-09-28 20:02:42,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-28 20:02:42,436 INFO [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-09-28 20:02:42,438 DEBUG [Listener at jenkins-hbase4.apache.org/41509] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,438 DEBUG [Listener at jenkins-hbase4.apache.org/41509] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695931361827.b24d449a79789a1b6d51da3725ba0d46. 2023-09-28 20:02:42,440 INFO [Listener at jenkins-hbase4.apache.org/41509] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-28 20:02:42,451 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-28 20:02:42,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695931362451 (current time:1695931362451). 2023-09-28 20:02:42,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-28 20:02:42,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] zookeeper.ReadOnlyZKClient(139): Connect 0x33183afa to 127.0.0.1:50329 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 20:02:42,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5dae14c7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 20:02:42,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 20:02:42,463 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51972, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 20:02:42,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x33183afa to 127.0.0.1:50329 2023-09-28 20:02:42,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 20:02:42,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] zookeeper.ReadOnlyZKClient(139): Connect 0x5dfd4278 to 127.0.0.1:50329 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 20:02:42,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2fc06cd7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 20:02:42,473 DEBUG [hconnection-0x2e55dc4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 20:02:42,474 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51974, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 20:02:42,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5dfd4278 to 127.0.0.1:50329 2023-09-28 20:02:42,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 20:02:42,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-28 20:02:42,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-28 20:02:42,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-28 20:02:42,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-28 20:02:42,484 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-28 20:02:42,484 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695931962484 2023-09-28 20:02:42,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-28 20:02:42,484 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,486 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-28 20:02:42,486 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-28 20:02:42,487 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-28 20:02:42,487 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-28 20:02:42,488 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-09-28 20:02:42,489 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-28 20:02:42,489 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695931962489 2023-09-28 20:02:42,500 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,500 INFO [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-28 20:02:42,500 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 20:02:42,501 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-28 20:02:42,501 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-28 20:02:42,502 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,502 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,503 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:02:42,503 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:42,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:02:42,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:02:42,503 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:02:42,503 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:02:42,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:02:42,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:02:42,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:02:42,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:02:42,503 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:42,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,503 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:42,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,504 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,504 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:42,504 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-28 20:02:42,504 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-28 20:02:42,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,504 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,504 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-28 20:02:42,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-28 20:02:42,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-28 20:02:42,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,505 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-28 20:02:42,505 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,505 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-28 20:02:42,505 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-28 20:02:42,505 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 20:02:42,505 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,506 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-28 20:02:42,506 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,506 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-28 20:02:42,506 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-28 20:02:42,507 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 20:02:42,506 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 20:02:42,506 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-28 20:02:42,508 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-28 20:02:42,508 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-28 20:02:42,508 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46795,1695931262192' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-28 20:02:42,508 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-28 20:02:42,509 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-28 20:02:42,509 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38759,1695931262240' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-28 20:02:42,509 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33091,1695931262281' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-28 20:02:42,515 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:42,515 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,515 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:42,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:02:42,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:02:42,516 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:42,516 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,516 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,516 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,516 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 20:02:42,516 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 20:02:42,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:02:42,516 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,516 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 20:02:42,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:02:42,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:42,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:42,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:42,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:02:42,518 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46795,1695931262192' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-28 20:02:42,518 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@75c2b29f[Count = 1] remaining members to acquire global barrier 2023-09-28 20:02:42,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:42,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:02:42,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:02:42,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:02:42,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:02:42,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:42,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:42,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:42,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:02:42,520 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38759,1695931262240' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-28 20:02:42,520 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@75c2b29f[Count = 0] remaining members to acquire global barrier 2023-09-28 20:02:42,520 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-28 20:02:42,520 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,521 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,521 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,521 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-28 20:02:42,521 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,521 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:42,521 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 20:02:42,521 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 20:02:42,521 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-28 20:02:42,521 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-28 20:02:42,522 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-28 20:02:42,521 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695931361827.b24d449a79789a1b6d51da3725ba0d46. 2023-09-28 20:02:42,522 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:42,522 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-28 20:02:42,522 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695931361827.11f74eed96fdac452b526f8efc696a36. 2023-09-28 20:02:42,522 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695931361827.b24d449a79789a1b6d51da3725ba0d46. started... 2023-09-28 20:02:42,522 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695931361827.11f74eed96fdac452b526f8efc696a36. started... 2023-09-28 20:02:42,522 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 20:02:42,522 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 20:02:42,522 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,33091,1695931262281' in zk 2023-09-28 20:02:42,522 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b24d449a79789a1b6d51da3725ba0d46: 2023-09-28 20:02:42,524 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 11f74eed96fdac452b526f8efc696a36: 2023-09-28 20:02:42,524 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695931361827.b24d449a79789a1b6d51da3725ba0d46.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,524 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695931361827.11f74eed96fdac452b526f8efc696a36.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,524 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 20:02:42,524 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 20:02:42,524 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-28 20:02:42,524 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-28 20:02:42,525 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-28 20:02:42,525 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 20:02:42,525 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-28 20:02:42,539 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695931361827.11f74eed96fdac452b526f8efc696a36. completed. 2023-09-28 20:02:42,540 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695931361827.11f74eed96fdac452b526f8efc696a36. 2023-09-28 20:02:42,540 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 20:02:42,540 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695931361827.b24d449a79789a1b6d51da3725ba0d46. completed. 2023-09-28 20:02:42,540 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695931361827.b24d449a79789a1b6d51da3725ba0d46. 2023-09-28 20:02:42,540 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 20:02:42,540 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:42,540 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 20:02:42,540 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 20:02:42,540 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-28 20:02:42,540 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:42,540 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,46795,1695931262192' in zk 2023-09-28 20:02:42,540 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-28 20:02:42,540 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,38759,1695931262240' in zk 2023-09-28 20:02:42,542 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-28 20:02:42,542 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:42,542 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-28 20:02:42,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:42,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:02:42,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:02:42,543 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 20:02:42,543 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:42,543 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 20:02:42,543 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-28 20:02:42,545 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-28 20:02:42,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:02:42,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:02:42,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:42,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:42,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:42,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:02:42,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:42,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:42,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:42,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,38759,1695931262240': 2023-09-28 20:02:42,549 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38759,1695931262240' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-28 20:02:42,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:42,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:02:42,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:02:42,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:02:42,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:02:42,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:42,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:42,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:42,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:02:42,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:42,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:42,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:42,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,46795,1695931262192': 2023-09-28 20:02:42,553 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46795,1695931262192' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-28 20:02:42,553 INFO [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-28 20:02:42,553 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-28 20:02:42,553 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-28 20:02:42,553 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,553 INFO [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-28 20:02:42,555 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,555 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:02:42,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:02:42,555 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,555 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:02:42,555 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:02:42,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,555 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:02:42,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,555 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:02:42,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:02:42,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:02:42,556 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:42,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:02:42,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:02:42,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:02:42,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:02:42,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,557 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:42,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:02:42,557 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:42,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:42,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:42,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:42,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:02:42,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,559 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:42,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:42,559 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:42,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:42,559 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:42,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:42,562 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:42,562 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,562 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:02:42,562 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:02:42,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:02:42,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:02:42,562 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:42,562 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:02:42,562 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,562 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:02:42,562 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:42,562 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 20:02:42,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:02:42,562 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:02:42,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:02:42,562 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,562 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:02:42,562 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:02:42,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:02:42,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:02:42,564 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,564 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:42,564 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-28 20:02:42,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:02:42,564 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,564 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:42,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:02:42,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:02:42,565 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:42,565 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,565 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:02:42,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:02:42,565 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-28 20:02:42,577 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,578 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,586 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 20:02:42,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-28 20:02:42,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-28 20:02:42,587 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-28 20:02:42,593 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,594 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-28 20:02:42,594 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,594 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,594 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695931362485Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695931362577 (+92 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695931362577Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695931362577Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695931362580 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695931362587 (+7 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695931362594 (+7 ms) 2023-09-28 20:02:42,597 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-28 20:02:42,598 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 111 msec 2023-09-28 20:02:42,788 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 20:02:42,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-28 20:02:42,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-28 20:02:42,791 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38759] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1695931361827.b24d449a79789a1b6d51da3725ba0d46. with WAL disabled. Data may be lost in the event of a crash. 2023-09-28 20:02:42,792 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46795] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1695931361827.11f74eed96fdac452b526f8efc696a36. with WAL disabled. Data may be lost in the event of a crash. 2023-09-28 20:02:42,794 DEBUG [Listener at jenkins-hbase4.apache.org/41509] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,794 DEBUG [Listener at jenkins-hbase4.apache.org/41509] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695931361827.b24d449a79789a1b6d51da3725ba0d46. 2023-09-28 20:02:42,795 INFO [Listener at jenkins-hbase4.apache.org/41509] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-28 20:02:42,803 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-28 20:02:42,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695931362803 (current time:1695931362803). 2023-09-28 20:02:42,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-28 20:02:42,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] zookeeper.ReadOnlyZKClient(139): Connect 0x00fd5c09 to 127.0.0.1:50329 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 20:02:42,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@285e3aaf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 20:02:42,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 20:02:42,813 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51986, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 20:02:42,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x00fd5c09 to 127.0.0.1:50329 2023-09-28 20:02:42,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 20:02:42,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] zookeeper.ReadOnlyZKClient(139): Connect 0x5487851b to 127.0.0.1:50329 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 20:02:42,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3ef08696, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 20:02:42,822 DEBUG [hconnection-0x67a248a5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 20:02:42,824 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51988, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 20:02:42,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5487851b to 127.0.0.1:50329 2023-09-28 20:02:42,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 20:02:42,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-28 20:02:42,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-28 20:02:42,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-28 20:02:42,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-28 20:02:42,833 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-28 20:02:42,834 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695931962834 2023-09-28 20:02:42,834 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-28 20:02:42,835 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-28 20:02:42,835 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-28 20:02:42,835 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-28 20:02:42,836 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-28 20:02:42,837 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-09-28 20:02:42,838 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-28 20:02:42,838 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695931962838 2023-09-28 20:02:42,850 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,850 INFO [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-28 20:02:42,850 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 20:02:42,852 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-28 20:02:42,852 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-28 20:02:42,852 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,852 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,853 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:02:42,853 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:02:42,853 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:42,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:02:42,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:02:42,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:02:42,853 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:02:42,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:02:42,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:02:42,854 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:42,854 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:42,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:02:42,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,854 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,854 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:42,854 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-28 20:02:42,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,854 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-28 20:02:42,854 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-28 20:02:42,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,855 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-28 20:02:42,855 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-28 20:02:42,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-28 20:02:42,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,855 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,855 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-28 20:02:42,855 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,855 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-28 20:02:42,855 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 20:02:42,855 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,855 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-28 20:02:42,856 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 20:02:42,856 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-28 20:02:42,858 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-28 20:02:42,858 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 20:02:42,856 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-28 20:02:42,859 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-28 20:02:42,859 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-28 20:02:42,859 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33091,1695931262281' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-28 20:02:42,859 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-28 20:02:42,858 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-28 20:02:42,859 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46795,1695931262192' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-28 20:02:42,859 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38759,1695931262240' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-28 20:02:42,861 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,862 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:42,862 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,862 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,862 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 20:02:42,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:42,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:02:42,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:02:42,862 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:42,862 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,862 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 20:02:42,862 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:02:42,862 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,862 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 20:02:42,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:02:42,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:42,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:42,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:42,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:02:42,864 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38759,1695931262240' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-28 20:02:42,864 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a05b148[Count = 1] remaining members to acquire global barrier 2023-09-28 20:02:42,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:42,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:02:42,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:02:42,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:02:42,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:02:42,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:42,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:42,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:42,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:02:42,866 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46795,1695931262192' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-28 20:02:42,866 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a05b148[Count = 0] remaining members to acquire global barrier 2023-09-28 20:02:42,866 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-28 20:02:42,866 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,870 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,870 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,870 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,870 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:42,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,871 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-28 20:02:42,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,871 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-28 20:02:42,871 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:42,871 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 20:02:42,871 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 20:02:42,871 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695931361827.11f74eed96fdac452b526f8efc696a36. 2023-09-28 20:02:42,871 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-28 20:02:42,871 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,33091,1695931262281' in zk 2023-09-28 20:02:42,871 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-28 20:02:42,871 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695931361827.11f74eed96fdac452b526f8efc696a36. started... 2023-09-28 20:02:42,871 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-28 20:02:42,871 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 20:02:42,871 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 20:02:42,871 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695931361827.b24d449a79789a1b6d51da3725ba0d46. 2023-09-28 20:02:42,871 INFO [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 11f74eed96fdac452b526f8efc696a36 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-28 20:02:42,871 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695931361827.b24d449a79789a1b6d51da3725ba0d46. started... 2023-09-28 20:02:42,872 INFO [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b24d449a79789a1b6d51da3725ba0d46 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-28 20:02:42,873 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-28 20:02:42,873 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 20:02:42,873 DEBUG [member: 'jenkins-hbase4.apache.org,33091,1695931262281' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-28 20:02:42,899 INFO [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230928ef2c9cbe994a407685871774eb801933 to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230928ef2c9cbe994a407685871774eb801933 2023-09-28 20:02:42,900 INFO [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309284363a435ed2b4982ba559f9b02316453 to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309284363a435ed2b4982ba559f9b02316453 2023-09-28 20:02:42,907 INFO [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithSkipTmp/b24d449a79789a1b6d51da3725ba0d46/.tmp/cf/60219a6ddfee421bb07c79b0a6378d4c 2023-09-28 20:02:42,908 INFO [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithSkipTmp/11f74eed96fdac452b526f8efc696a36/.tmp/cf/ceb354fe59b348aa87b6e50ecadad19a 2023-09-28 20:02:42,914 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithSkipTmp/b24d449a79789a1b6d51da3725ba0d46/.tmp/cf/60219a6ddfee421bb07c79b0a6378d4c as hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithSkipTmp/b24d449a79789a1b6d51da3725ba0d46/cf/60219a6ddfee421bb07c79b0a6378d4c 2023-09-28 20:02:42,915 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithSkipTmp/11f74eed96fdac452b526f8efc696a36/.tmp/cf/ceb354fe59b348aa87b6e50ecadad19a as hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithSkipTmp/11f74eed96fdac452b526f8efc696a36/cf/ceb354fe59b348aa87b6e50ecadad19a 2023-09-28 20:02:42,921 INFO [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithSkipTmp/b24d449a79789a1b6d51da3725ba0d46/cf/60219a6ddfee421bb07c79b0a6378d4c, entries=4, sequenceid=6, filesize=5.6 K 2023-09-28 20:02:42,921 INFO [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithSkipTmp/11f74eed96fdac452b526f8efc696a36/cf/ceb354fe59b348aa87b6e50ecadad19a, entries=46, sequenceid=6, filesize=13.2 K 2023-09-28 20:02:42,922 INFO [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for b24d449a79789a1b6d51da3725ba0d46 in 50ms, sequenceid=6, compaction requested=false 2023-09-28 20:02:42,922 INFO [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 11f74eed96fdac452b526f8efc696a36 in 51ms, sequenceid=6, compaction requested=false 2023-09-28 20:02:42,922 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-28 20:02:42,922 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-28 20:02:42,927 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 11f74eed96fdac452b526f8efc696a36: 2023-09-28 20:02:42,927 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b24d449a79789a1b6d51da3725ba0d46: 2023-09-28 20:02:42,927 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695931361827.11f74eed96fdac452b526f8efc696a36.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,927 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695931361827.b24d449a79789a1b6d51da3725ba0d46.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,927 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 20:02:42,927 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 20:02:42,927 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithSkipTmp/11f74eed96fdac452b526f8efc696a36/cf/ceb354fe59b348aa87b6e50ecadad19a] hfiles 2023-09-28 20:02:42,927 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithSkipTmp/b24d449a79789a1b6d51da3725ba0d46/cf/60219a6ddfee421bb07c79b0a6378d4c] hfiles 2023-09-28 20:02:42,927 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithSkipTmp/b24d449a79789a1b6d51da3725ba0d46/cf/60219a6ddfee421bb07c79b0a6378d4c for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,927 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithSkipTmp/11f74eed96fdac452b526f8efc696a36/cf/ceb354fe59b348aa87b6e50ecadad19a for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,935 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 20:02:42,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-28 20:02:42,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-28 20:02:42,936 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-28 20:02:42,942 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695931361827.11f74eed96fdac452b526f8efc696a36. completed. 2023-09-28 20:02:42,942 DEBUG [rs(jenkins-hbase4.apache.org,46795,1695931262192)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695931361827.11f74eed96fdac452b526f8efc696a36. 2023-09-28 20:02:42,942 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 20:02:42,942 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 20:02:42,942 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:42,943 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-28 20:02:42,943 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,46795,1695931262192' in zk 2023-09-28 20:02:42,943 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695931361827.b24d449a79789a1b6d51da3725ba0d46. completed. 2023-09-28 20:02:42,943 DEBUG [rs(jenkins-hbase4.apache.org,38759,1695931262240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695931361827.b24d449a79789a1b6d51da3725ba0d46. 2023-09-28 20:02:42,943 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 20:02:42,943 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 20:02:42,943 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:42,943 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-28 20:02:42,943 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,38759,1695931262240' in zk 2023-09-28 20:02:42,944 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-28 20:02:42,944 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:42,945 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 20:02:42,945 DEBUG [member: 'jenkins-hbase4.apache.org,46795,1695931262192' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-28 20:02:42,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:42,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:02:42,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:02:42,946 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-28 20:02:42,947 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:42,947 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 20:02:42,947 DEBUG [member: 'jenkins-hbase4.apache.org,38759,1695931262240' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-28 20:02:42,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:02:42,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:02:42,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:42,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:42,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:42,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:02:42,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:42,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:42,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:42,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,46795,1695931262192': 2023-09-28 20:02:42,951 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46795,1695931262192' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-28 20:02:42,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:42,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:02:42,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:02:42,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:02:42,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:02:42,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:42,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:42,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:42,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:02:42,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:42,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:42,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:42,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,38759,1695931262240': 2023-09-28 20:02:42,954 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38759,1695931262240' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-28 20:02:42,954 INFO [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-28 20:02:42,954 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-28 20:02:42,954 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-28 20:02:42,954 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,955 INFO [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-28 20:02:42,956 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,956 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,956 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,956 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:02:42,956 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:02:42,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,956 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,956 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:02:42,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 20:02:42,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 20:02:42,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:02:42,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:02:42,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 20:02:42,957 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:42,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:02:42,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:02:42,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:02:42,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:02:42,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,957 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:42,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,958 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:42,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 20:02:42,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:42,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:42,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:42,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 20:02:42,960 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:42,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,960 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:42,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:42,960 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:42,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:42,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:42,964 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:02:42,964 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:42,964 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:02:42,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:02:42,964 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 20:02:42,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:02:42,965 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,964 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:02:42,964 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:02:42,964 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,965 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:02:42,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 20:02:42,965 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,965 DEBUG [(jenkins-hbase4.apache.org,35173,1695931260872)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 20:02:42,965 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 20:02:42,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:02:42,965 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-28 20:02:42,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 20:02:42,965 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:42,967 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:42,967 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:02:42,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:02:42,967 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:42,967 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,967 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:02:42,967 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:42,967 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,967 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:02:42,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:02:42,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 20:02:42,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 20:02:42,967 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309284363a435ed2b4982ba559f9b02316453, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230928ef2c9cbe994a407685871774eb801933] mob files 2023-09-28 20:02:42,968 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309284363a435ed2b4982ba559f9b02316453 2023-09-28 20:02:42,968 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230928ef2c9cbe994a407685871774eb801933 2023-09-28 20:02:42,975 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,976 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,994 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,995 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-28 20:02:42,995 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,996 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:42,996 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695931362834Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695931362975 (+141 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695931362975Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1695931362975Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1695931362979 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695931362988 (+9 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695931362995 (+7 ms) 2023-09-28 20:02:42,999 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-28 20:02:43,000 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 164 msec 2023-09-28 20:02:43,136 DEBUG [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 20:02:43,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-28 20:02:43,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-28 20:02:43,138 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/export-test/export-1695931363138 2023-09-28 20:02:43,138 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43143, tgtDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/export-test/export-1695931363138, rawTgtDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/export-test/export-1695931363138, srcFsUri=hdfs://localhost:43143, srcDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff 2023-09-28 20:02:43,161 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43143, inputRoot=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff 2023-09-28 20:02:43,161 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-473448400_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/export-test/export-1695931363138, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/export-test/export-1695931363138/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:43,161 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43143, inputRoot=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff, snapshotDir=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-09-28 20:02:43,172 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/export-test/export-1695931363138/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:43,186 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-28 20:02:43,186 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-28 20:02:43,186 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-28 20:02:43,187 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-28 20:02:44,061 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/hadoop-7019679991344768470.jar 2023-09-28 20:02:44,062 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-28 20:02:44,062 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-28 20:02:44,136 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/hadoop-8735418223769359483.jar 2023-09-28 20:02:44,137 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-28 20:02:44,137 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-28 20:02:44,138 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-28 20:02:44,138 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-28 20:02:44,138 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-28 20:02:44,138 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-28 20:02:44,139 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-28 20:02:44,139 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-28 20:02:44,140 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-28 20:02:44,140 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-28 20:02:44,140 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-28 20:02:44,141 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-28 20:02:44,141 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-28 20:02:44,141 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-28 20:02:44,142 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-28 20:02:44,142 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-28 20:02:44,143 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 20:02:44,143 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 20:02:44,144 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 20:02:44,144 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 20:02:44,144 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 20:02:44,145 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 20:02:44,145 DEBUG [Listener at jenkins-hbase4.apache.org/41509] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 20:02:44,496 WARN [Listener at jenkins-hbase4.apache.org/41509] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-28 20:02:44,498 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-09-28 20:02:44,499 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-09-28 20:02:46,373 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 20:02:46,373 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 20:02:46,375 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695931268848_0006_000001 (auth:SIMPLE) 2023-09-28 20:02:46,747 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695931268848_0007_000001 (auth:SIMPLE) 2023-09-28 20:02:47,100 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-28 20:02:50,616 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695931268848_0007_000001 (auth:SIMPLE) 2023-09-28 20:02:52,832 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695931268848_0007_000001 (auth:SIMPLE) 2023-09-28 20:02:55,388 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695931268848_0007_000001 (auth:SIMPLE) 2023-09-28 20:02:56,663 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-28 20:02:56,663 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-28 20:02:56,675 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:56,675 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-28 20:02:56,675 INFO [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-28 20:02:56,676 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_394157282_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:56,676 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(367): hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-28 20:02:56,676 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(367): hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-28 20:02:56,676 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_394157282_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/export-test/export-1695931363138/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/export-test/export-1695931363138/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:56,676 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(367): hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/export-test/export-1695931363138/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-28 20:02:56,677 DEBUG [Listener at jenkins-hbase4.apache.org/41509] snapshot.TestExportSnapshot(367): hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/export-test/export-1695931363138/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-28 20:02:56,682 INFO [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:56,682 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:56,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:56,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-28 20:02:56,686 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695931376686"}]},"ts":"1695931376686"} 2023-09-28 20:02:56,688 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-09-28 20:02:56,689 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-09-28 20:02:56,690 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b24d449a79789a1b6d51da3725ba0d46, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=11f74eed96fdac452b526f8efc696a36, UNASSIGN}] 2023-09-28 20:02:56,692 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b24d449a79789a1b6d51da3725ba0d46, UNASSIGN 2023-09-28 20:02:56,692 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=11f74eed96fdac452b526f8efc696a36, UNASSIGN 2023-09-28 20:02:56,692 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=b24d449a79789a1b6d51da3725ba0d46, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:02:56,692 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=11f74eed96fdac452b526f8efc696a36, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:02:56,693 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695931361827.11f74eed96fdac452b526f8efc696a36.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695931376692"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695931376692"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695931376692"}]},"ts":"1695931376692"} 2023-09-28 20:02:56,693 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695931361827.b24d449a79789a1b6d51da3725ba0d46.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695931376692"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695931376692"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695931376692"}]},"ts":"1695931376692"} 2023-09-28 20:02:56,694 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure b24d449a79789a1b6d51da3725ba0d46, server=jenkins-hbase4.apache.org,38759,1695931262240}] 2023-09-28 20:02:56,695 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 11f74eed96fdac452b526f8efc696a36, server=jenkins-hbase4.apache.org,46795,1695931262192}] 2023-09-28 20:02:56,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-28 20:02:56,846 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b24d449a79789a1b6d51da3725ba0d46 2023-09-28 20:02:56,846 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b24d449a79789a1b6d51da3725ba0d46, disabling compactions & flushes 2023-09-28 20:02:56,846 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695931361827.b24d449a79789a1b6d51da3725ba0d46. 2023-09-28 20:02:56,846 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695931361827.b24d449a79789a1b6d51da3725ba0d46. 2023-09-28 20:02:56,846 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695931361827.b24d449a79789a1b6d51da3725ba0d46. after waiting 0 ms 2023-09-28 20:02:56,846 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695931361827.b24d449a79789a1b6d51da3725ba0d46. 2023-09-28 20:02:56,850 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 11f74eed96fdac452b526f8efc696a36 2023-09-28 20:02:56,850 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 11f74eed96fdac452b526f8efc696a36, disabling compactions & flushes 2023-09-28 20:02:56,850 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695931361827.11f74eed96fdac452b526f8efc696a36. 2023-09-28 20:02:56,851 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695931361827.11f74eed96fdac452b526f8efc696a36. 2023-09-28 20:02:56,851 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695931361827.11f74eed96fdac452b526f8efc696a36. after waiting 0 ms 2023-09-28 20:02:56,851 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695931361827.11f74eed96fdac452b526f8efc696a36. 2023-09-28 20:02:56,864 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithSkipTmp/b24d449a79789a1b6d51da3725ba0d46/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-28 20:02:56,864 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/default/testtb-testExportFileSystemStateWithSkipTmp/11f74eed96fdac452b526f8efc696a36/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-28 20:02:56,865 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 20:02:56,866 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695931361827.b24d449a79789a1b6d51da3725ba0d46. 2023-09-28 20:02:56,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b24d449a79789a1b6d51da3725ba0d46: 2023-09-28 20:02:56,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 20:02:56,867 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695931361827.11f74eed96fdac452b526f8efc696a36. 2023-09-28 20:02:56,867 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 11f74eed96fdac452b526f8efc696a36: 2023-09-28 20:02:56,868 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b24d449a79789a1b6d51da3725ba0d46 2023-09-28 20:02:56,868 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=b24d449a79789a1b6d51da3725ba0d46, regionState=CLOSED 2023-09-28 20:02:56,868 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695931361827.b24d449a79789a1b6d51da3725ba0d46.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695931376868"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695931376868"}]},"ts":"1695931376868"} 2023-09-28 20:02:56,868 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 11f74eed96fdac452b526f8efc696a36 2023-09-28 20:02:56,869 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=11f74eed96fdac452b526f8efc696a36, regionState=CLOSED 2023-09-28 20:02:56,869 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695931361827.11f74eed96fdac452b526f8efc696a36.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695931376869"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695931376869"}]},"ts":"1695931376869"} 2023-09-28 20:02:56,871 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=115 2023-09-28 20:02:56,871 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure b24d449a79789a1b6d51da3725ba0d46, server=jenkins-hbase4.apache.org,38759,1695931262240 in 176 msec 2023-09-28 20:02:56,872 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-09-28 20:02:56,872 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 11f74eed96fdac452b526f8efc696a36, server=jenkins-hbase4.apache.org,46795,1695931262192 in 175 msec 2023-09-28 20:02:56,872 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b24d449a79789a1b6d51da3725ba0d46, UNASSIGN in 181 msec 2023-09-28 20:02:56,873 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=116, resume processing ppid=114 2023-09-28 20:02:56,873 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=11f74eed96fdac452b526f8efc696a36, UNASSIGN in 182 msec 2023-09-28 20:02:56,874 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695931376874"}]},"ts":"1695931376874"} 2023-09-28 20:02:56,875 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-09-28 20:02:56,877 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-09-28 20:02:56,879 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 195 msec 2023-09-28 20:02:56,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-28 20:02:56,989 INFO [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-09-28 20:02:56,990 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:56,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:56,993 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:56,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:56,993 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:56,995 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33091] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:56,997 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:56,997 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:56,997 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:56,997 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:56,997 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-28 20:02:56,997 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-28 20:02:56,998 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-28 20:02:56,998 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-28 20:02:56,998 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b24d449a79789a1b6d51da3725ba0d46 2023-09-28 20:02:56,998 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/11f74eed96fdac452b526f8efc696a36 2023-09-28 20:02:56,998 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:56,998 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:56,998 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 20:02:56,998 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:56,998 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 20:02:56,998 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:56,999 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 20:02:56,999 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 20:02:57,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-28 20:02:57,000 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b24d449a79789a1b6d51da3725ba0d46/cf, FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b24d449a79789a1b6d51da3725ba0d46/recovered.edits] 2023-09-28 20:02:57,000 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/11f74eed96fdac452b526f8efc696a36/cf, FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/11f74eed96fdac452b526f8efc696a36/recovered.edits] 2023-09-28 20:02:57,004 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/11f74eed96fdac452b526f8efc696a36/cf/ceb354fe59b348aa87b6e50ecadad19a to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/11f74eed96fdac452b526f8efc696a36/cf/ceb354fe59b348aa87b6e50ecadad19a 2023-09-28 20:02:57,004 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b24d449a79789a1b6d51da3725ba0d46/cf/60219a6ddfee421bb07c79b0a6378d4c to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/b24d449a79789a1b6d51da3725ba0d46/cf/60219a6ddfee421bb07c79b0a6378d4c 2023-09-28 20:02:57,007 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/11f74eed96fdac452b526f8efc696a36/recovered.edits/9.seqid to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/11f74eed96fdac452b526f8efc696a36/recovered.edits/9.seqid 2023-09-28 20:02:57,007 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b24d449a79789a1b6d51da3725ba0d46/recovered.edits/9.seqid to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/b24d449a79789a1b6d51da3725ba0d46/recovered.edits/9.seqid 2023-09-28 20:02:57,008 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/11f74eed96fdac452b526f8efc696a36 2023-09-28 20:02:57,008 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b24d449a79789a1b6d51da3725ba0d46 2023-09-28 20:02:57,008 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-28 20:02:57,009 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-28 20:02:57,009 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-09-28 20:02:57,013 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309284363a435ed2b4982ba559f9b02316453 to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309284363a435ed2b4982ba559f9b02316453 2023-09-28 20:02:57,014 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230928ef2c9cbe994a407685871774eb801933 to hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230928ef2c9cbe994a407685871774eb801933 2023-09-28 20:02:57,015 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-28 20:02:57,017 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:57,020 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-09-28 20:02:57,022 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-09-28 20:02:57,023 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:57,023 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-09-28 20:02:57,023 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695931361827.b24d449a79789a1b6d51da3725ba0d46.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695931377023"}]},"ts":"9223372036854775807"} 2023-09-28 20:02:57,023 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695931361827.11f74eed96fdac452b526f8efc696a36.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695931377023"}]},"ts":"9223372036854775807"} 2023-09-28 20:02:57,025 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-28 20:02:57,025 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b24d449a79789a1b6d51da3725ba0d46, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695931361827.b24d449a79789a1b6d51da3725ba0d46.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 11f74eed96fdac452b526f8efc696a36, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695931361827.11f74eed96fdac452b526f8efc696a36.', STARTKEY => '1', ENDKEY => ''}] 2023-09-28 20:02:57,025 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-09-28 20:02:57,025 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695931377025"}]},"ts":"9223372036854775807"} 2023-09-28 20:02:57,026 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-09-28 20:02:57,029 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:57,030 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 39 msec 2023-09-28 20:02:57,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-28 20:02:57,101 INFO [Listener at jenkins-hbase4.apache.org/41509] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-09-28 20:02:57,108 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-28 20:02:57,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:57,111 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-28 20:02:57,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35173] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 20:02:57,138 INFO [Listener at jenkins-hbase4.apache.org/41509] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=766 (was 764) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_394157282_17 at /127.0.0.1:48264 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1dd01c2f-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_394157282_17 at /127.0.0.1:41446 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1dd01c2f-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2092539706_1 at /127.0.0.1:41434 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2092539706_1 at /127.0.0.1:46666 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:37463 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x1dd01c2f-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5217 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_394157282_17 at /127.0.0.1:46702 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1dd01c2f-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=903 (was 938), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=177 (was 190), ProcessCount=168 (was 168), AvailableMemoryMB=4429 (was 4532) 2023-09-28 20:02:57,138 WARN [Listener at jenkins-hbase4.apache.org/41509] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-28 20:02:57,138 INFO [Listener at jenkins-hbase4.apache.org/41509] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-09-28 20:02:57,149 INFO [Listener at jenkins-hbase4.apache.org/41509] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-28 20:03:01,575 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695931268848_0007_000001 (auth:SIMPLE) 2023-09-28 20:03:02,438 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-28 20:03:11,272 INFO [Listener at jenkins-hbase4.apache.org/41509] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-28 20:03:25,390 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-28 20:03:25,391 INFO [Listener at jenkins-hbase4.apache.org/41509] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-28 20:03:25,499 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-09-28 20:03:25,508 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-09-28 20:03:25,509 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-28 20:03:25,519 INFO [Listener at jenkins-hbase4.apache.org/41509] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-28 20:03:25,623 ERROR [Thread[Thread-385,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-28 20:03:25,623 INFO [Listener at jenkins-hbase4.apache.org/41509] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-09-28 20:03:25,623 INFO [Listener at jenkins-hbase4.apache.org/41509] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-09-28 20:03:25,623 INFO [Listener at jenkins-hbase4.apache.org/41509] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-09-28 20:03:25,623 DEBUG [Listener at jenkins-hbase4.apache.org/41509] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x627146cd to 127.0.0.1:50329 2023-09-28 20:03:25,623 DEBUG [Listener at jenkins-hbase4.apache.org/41509] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 20:03:25,623 DEBUG [Listener at jenkins-hbase4.apache.org/41509] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-09-28 20:03:25,624 DEBUG [Listener at jenkins-hbase4.apache.org/41509] util.JVMClusterUtil(257): Found active master hash=1496635824, stopped=false 2023-09-28 20:03:25,624 DEBUG [Listener at jenkins-hbase4.apache.org/41509] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 20:03:25,624 DEBUG [Listener at jenkins-hbase4.apache.org/41509] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-28 20:03:25,624 INFO [Listener at jenkins-hbase4.apache.org/41509] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,35173,1695931260872 2023-09-28 20:03:25,625 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-28 20:03:25,626 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-28 20:03:25,626 INFO [Listener at jenkins-hbase4.apache.org/41509] procedure2.ProcedureExecutor(628): Stopping 2023-09-28 20:03:25,626 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-28 20:03:25,626 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-28 20:03:25,626 DEBUG [Listener at jenkins-hbase4.apache.org/41509] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x10077163 to 127.0.0.1:50329 2023-09-28 20:03:25,626 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-28 20:03:25,626 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-28 20:03:25,626 DEBUG [Listener at jenkins-hbase4.apache.org/41509] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 20:03:25,626 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-28 20:03:25,626 INFO [Listener at jenkins-hbase4.apache.org/41509] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,46795,1695931262192' ***** 2023-09-28 20:03:25,626 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-28 20:03:25,626 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-28 20:03:25,627 DEBUG [Listener at jenkins-hbase4.apache.org/41509] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 20:03:25,627 INFO [Listener at jenkins-hbase4.apache.org/41509] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-28 20:03:25,627 INFO [Listener at jenkins-hbase4.apache.org/41509] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,38759,1695931262240' ***** 2023-09-28 20:03:25,627 DEBUG [Listener at jenkins-hbase4.apache.org/41509] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 20:03:25,627 INFO [Listener at jenkins-hbase4.apache.org/41509] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-28 20:03:25,627 INFO [RS:0;jenkins-hbase4:46795] regionserver.HeapMemoryManager(220): Stopping 2023-09-28 20:03:25,627 INFO [Listener at jenkins-hbase4.apache.org/41509] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,33091,1695931262281' ***** 2023-09-28 20:03:25,627 INFO [RS:0;jenkins-hbase4:46795] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-28 20:03:25,627 DEBUG [Listener at jenkins-hbase4.apache.org/41509] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 20:03:25,627 INFO [RS:0;jenkins-hbase4:46795] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-28 20:03:25,627 INFO [Listener at jenkins-hbase4.apache.org/41509] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-28 20:03:25,627 INFO [RS:1;jenkins-hbase4:38759] regionserver.HeapMemoryManager(220): Stopping 2023-09-28 20:03:25,627 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-28 20:03:25,628 INFO [RS:1;jenkins-hbase4:38759] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-28 20:03:25,628 INFO [RS:0;jenkins-hbase4:46795] regionserver.HRegionServer(3305): Received CLOSE for 48b47cf85185d27ccab02c8aa249b389 2023-09-28 20:03:25,628 INFO [RS:1;jenkins-hbase4:38759] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-28 20:03:25,628 INFO [RS:2;jenkins-hbase4:33091] regionserver.HeapMemoryManager(220): Stopping 2023-09-28 20:03:25,628 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-28 20:03:25,628 INFO [RS:2;jenkins-hbase4:33091] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-28 20:03:25,628 INFO [RS:1;jenkins-hbase4:38759] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:03:25,628 INFO [RS:2;jenkins-hbase4:33091] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-28 20:03:25,628 DEBUG [RS:1;jenkins-hbase4:38759] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x44f33540 to 127.0.0.1:50329 2023-09-28 20:03:25,628 INFO [RS:2;jenkins-hbase4:33091] regionserver.HRegionServer(3305): Received CLOSE for a53080a21eb6cd483bc926ad9302320f 2023-09-28 20:03:25,628 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-28 20:03:25,628 INFO [RS:2;jenkins-hbase4:33091] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:03:25,629 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 48b47cf85185d27ccab02c8aa249b389, disabling compactions & flushes 2023-09-28 20:03:25,629 DEBUG [RS:2;jenkins-hbase4:33091] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x774d9bf2 to 127.0.0.1:50329 2023-09-28 20:03:25,630 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a53080a21eb6cd483bc926ad9302320f, disabling compactions & flushes 2023-09-28 20:03:25,628 DEBUG [RS:1;jenkins-hbase4:38759] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 20:03:25,628 INFO [RS:0;jenkins-hbase4:46795] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:03:25,630 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695931265224.a53080a21eb6cd483bc926ad9302320f. 2023-09-28 20:03:25,630 DEBUG [RS:2;jenkins-hbase4:33091] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 20:03:25,630 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695931264468.48b47cf85185d27ccab02c8aa249b389. 2023-09-28 20:03:25,631 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695931265224.a53080a21eb6cd483bc926ad9302320f. 2023-09-28 20:03:25,632 INFO [RS:2;jenkins-hbase4:33091] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-28 20:03:25,632 INFO [RS:2;jenkins-hbase4:33091] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-28 20:03:25,633 INFO [RS:2;jenkins-hbase4:33091] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-28 20:03:25,631 INFO [RS:1;jenkins-hbase4:38759] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,38759,1695931262240; all regions closed. 2023-09-28 20:03:25,633 INFO [RS:2;jenkins-hbase4:33091] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-09-28 20:03:25,631 DEBUG [RS:0;jenkins-hbase4:46795] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x11571638 to 127.0.0.1:50329 2023-09-28 20:03:25,632 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695931265224.a53080a21eb6cd483bc926ad9302320f. after waiting 0 ms 2023-09-28 20:03:25,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695931265224.a53080a21eb6cd483bc926ad9302320f. 2023-09-28 20:03:25,632 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695931264468.48b47cf85185d27ccab02c8aa249b389. 2023-09-28 20:03:25,633 DEBUG [RS:0;jenkins-hbase4:46795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 20:03:25,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695931264468.48b47cf85185d27ccab02c8aa249b389. after waiting 0 ms 2023-09-28 20:03:25,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695931264468.48b47cf85185d27ccab02c8aa249b389. 2023-09-28 20:03:25,633 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing a53080a21eb6cd483bc926ad9302320f 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-09-28 20:03:25,633 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 48b47cf85185d27ccab02c8aa249b389 1/1 column families, dataSize=78 B heapSize=488 B 2023-09-28 20:03:25,633 INFO [RS:0;jenkins-hbase4:46795] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-28 20:03:25,633 INFO [RS:2;jenkins-hbase4:33091] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-09-28 20:03:25,634 DEBUG [RS:0;jenkins-hbase4:46795] regionserver.HRegionServer(1478): Online Regions={48b47cf85185d27ccab02c8aa249b389=hbase:namespace,,1695931264468.48b47cf85185d27ccab02c8aa249b389.} 2023-09-28 20:03:25,634 DEBUG [RS:2;jenkins-hbase4:33091] regionserver.HRegionServer(1478): Online Regions={a53080a21eb6cd483bc926ad9302320f=hbase:acl,,1695931265224.a53080a21eb6cd483bc926ad9302320f., 1588230740=hbase:meta,,1.1588230740} 2023-09-28 20:03:25,634 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-28 20:03:25,634 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-28 20:03:25,634 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-28 20:03:25,634 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-28 20:03:25,634 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-28 20:03:25,634 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-09-28 20:03:25,635 DEBUG [RS:0;jenkins-hbase4:46795] regionserver.HRegionServer(1504): Waiting on 48b47cf85185d27ccab02c8aa249b389 2023-09-28 20:03:25,635 DEBUG [RS:2;jenkins-hbase4:33091] regionserver.HRegionServer(1504): Waiting on 1588230740, a53080a21eb6cd483bc926ad9302320f 2023-09-28 20:03:25,654 DEBUG [RS:1;jenkins-hbase4:38759] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/oldWALs 2023-09-28 20:03:25,654 INFO [RS:1;jenkins-hbase4:38759] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38759%2C1695931262240:(num 1695931263957) 2023-09-28 20:03:25,654 DEBUG [RS:1;jenkins-hbase4:38759] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 20:03:25,654 INFO [RS:1;jenkins-hbase4:38759] regionserver.LeaseManager(133): Closed leases 2023-09-28 20:03:25,656 INFO [RS:1;jenkins-hbase4:38759] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-28 20:03:25,656 INFO [RS:1;jenkins-hbase4:38759] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-28 20:03:25,656 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-28 20:03:25,656 INFO [RS:1;jenkins-hbase4:38759] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-28 20:03:25,657 INFO [RS:1;jenkins-hbase4:38759] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-28 20:03:25,658 INFO [RS:1;jenkins-hbase4:38759] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38759 2023-09-28 20:03:25,660 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/hbase/meta/1588230740/.tmp/info/d919de060ab84db89b37011efc946659 2023-09-28 20:03:25,661 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/hbase/acl/a53080a21eb6cd483bc926ad9302320f/.tmp/l/8af77ed579a841d9ac0fca8f18ee8690 2023-09-28 20:03:25,663 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/hbase/namespace/48b47cf85185d27ccab02c8aa249b389/.tmp/info/e8705938a8ee48e5a75aa354a0ec71a0 2023-09-28 20:03:25,665 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-28 20:03:25,665 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:03:25,665 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:03:25,665 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38759,1695931262240 2023-09-28 20:03:25,665 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-28 20:03:25,665 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-28 20:03:25,665 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-28 20:03:25,665 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38759,1695931262240] 2023-09-28 20:03:25,669 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38759,1695931262240; numProcessing=1 2023-09-28 20:03:25,671 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38759,1695931262240 already deleted, retry=false 2023-09-28 20:03:25,671 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38759,1695931262240 expired; onlineServers=2 2023-09-28 20:03:25,672 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d919de060ab84db89b37011efc946659 2023-09-28 20:03:25,672 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8af77ed579a841d9ac0fca8f18ee8690 2023-09-28 20:03:25,673 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/hbase/acl/a53080a21eb6cd483bc926ad9302320f/.tmp/l/8af77ed579a841d9ac0fca8f18ee8690 as hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/hbase/acl/a53080a21eb6cd483bc926ad9302320f/l/8af77ed579a841d9ac0fca8f18ee8690 2023-09-28 20:03:25,674 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/hbase/namespace/48b47cf85185d27ccab02c8aa249b389/.tmp/info/e8705938a8ee48e5a75aa354a0ec71a0 as hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/hbase/namespace/48b47cf85185d27ccab02c8aa249b389/info/e8705938a8ee48e5a75aa354a0ec71a0 2023-09-28 20:03:25,679 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8af77ed579a841d9ac0fca8f18ee8690 2023-09-28 20:03:25,679 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/hbase/acl/a53080a21eb6cd483bc926ad9302320f/l/8af77ed579a841d9ac0fca8f18ee8690, entries=7, sequenceid=18, filesize=5.2 K 2023-09-28 20:03:25,680 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for a53080a21eb6cd483bc926ad9302320f in 47ms, sequenceid=18, compaction requested=false 2023-09-28 20:03:25,681 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/hbase/namespace/48b47cf85185d27ccab02c8aa249b389/info/e8705938a8ee48e5a75aa354a0ec71a0, entries=2, sequenceid=6, filesize=4.8 K 2023-09-28 20:03:25,684 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 48b47cf85185d27ccab02c8aa249b389 in 51ms, sequenceid=6, compaction requested=false 2023-09-28 20:03:25,691 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/hbase/acl/a53080a21eb6cd483bc926ad9302320f/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-09-28 20:03:25,692 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 20:03:25,693 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1695931265224.a53080a21eb6cd483bc926ad9302320f. 2023-09-28 20:03:25,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a53080a21eb6cd483bc926ad9302320f: 2023-09-28 20:03:25,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/hbase/namespace/48b47cf85185d27ccab02c8aa249b389/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-28 20:03:25,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1695931265224.a53080a21eb6cd483bc926ad9302320f. 2023-09-28 20:03:25,694 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/hbase/meta/1588230740/.tmp/rep_barrier/a741c05d65614b639ec1af85e6a4c764 2023-09-28 20:03:25,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 20:03:25,695 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695931264468.48b47cf85185d27ccab02c8aa249b389. 2023-09-28 20:03:25,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 48b47cf85185d27ccab02c8aa249b389: 2023-09-28 20:03:25,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1695931264468.48b47cf85185d27ccab02c8aa249b389. 2023-09-28 20:03:25,699 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a741c05d65614b639ec1af85e6a4c764 2023-09-28 20:03:25,700 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-28 20:03:25,701 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-28 20:03:25,702 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-28 20:03:25,713 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/hbase/meta/1588230740/.tmp/table/eda7b5ea89874919809bc8d43de0a86f 2023-09-28 20:03:25,718 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for eda7b5ea89874919809bc8d43de0a86f 2023-09-28 20:03:25,719 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/hbase/meta/1588230740/.tmp/info/d919de060ab84db89b37011efc946659 as hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/hbase/meta/1588230740/info/d919de060ab84db89b37011efc946659 2023-09-28 20:03:25,723 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d919de060ab84db89b37011efc946659 2023-09-28 20:03:25,723 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/hbase/meta/1588230740/info/d919de060ab84db89b37011efc946659, entries=48, sequenceid=131, filesize=10.3 K 2023-09-28 20:03:25,724 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/hbase/meta/1588230740/.tmp/rep_barrier/a741c05d65614b639ec1af85e6a4c764 as hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/hbase/meta/1588230740/rep_barrier/a741c05d65614b639ec1af85e6a4c764 2023-09-28 20:03:25,729 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a741c05d65614b639ec1af85e6a4c764 2023-09-28 20:03:25,729 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/hbase/meta/1588230740/rep_barrier/a741c05d65614b639ec1af85e6a4c764, entries=13, sequenceid=131, filesize=6.4 K 2023-09-28 20:03:25,730 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/hbase/meta/1588230740/.tmp/table/eda7b5ea89874919809bc8d43de0a86f as hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/hbase/meta/1588230740/table/eda7b5ea89874919809bc8d43de0a86f 2023-09-28 20:03:25,735 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for eda7b5ea89874919809bc8d43de0a86f 2023-09-28 20:03:25,735 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/hbase/meta/1588230740/table/eda7b5ea89874919809bc8d43de0a86f, entries=24, sequenceid=131, filesize=6.9 K 2023-09-28 20:03:25,736 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 102ms, sequenceid=131, compaction requested=false 2023-09-28 20:03:25,746 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-09-28 20:03:25,746 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 20:03:25,746 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-28 20:03:25,747 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-28 20:03:25,747 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-28 20:03:25,747 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-09-28 20:03:25,766 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-28 20:03:25,766 INFO [RS:1;jenkins-hbase4:38759] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,38759,1695931262240; zookeeper connection closed. 2023-09-28 20:03:25,766 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:38759-0x100f42093bb0002, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-28 20:03:25,767 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@dc4beef] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@dc4beef 2023-09-28 20:03:25,794 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-09-28 20:03:25,794 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-09-28 20:03:25,835 INFO [RS:0;jenkins-hbase4:46795] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,46795,1695931262192; all regions closed. 2023-09-28 20:03:25,835 INFO [RS:2;jenkins-hbase4:33091] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,33091,1695931262281; all regions closed. 2023-09-28 20:03:25,840 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/WALs/jenkins-hbase4.apache.org,46795,1695931262192/jenkins-hbase4.apache.org%2C46795%2C1695931262192.1695931263957 not finished, retry = 0 2023-09-28 20:03:25,842 DEBUG [RS:2;jenkins-hbase4:33091] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/oldWALs 2023-09-28 20:03:25,842 INFO [RS:2;jenkins-hbase4:33091] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33091%2C1695931262281.meta:.meta(num 1695931264163) 2023-09-28 20:03:25,847 DEBUG [RS:2;jenkins-hbase4:33091] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/oldWALs 2023-09-28 20:03:25,848 INFO [RS:2;jenkins-hbase4:33091] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33091%2C1695931262281:(num 1695931263957) 2023-09-28 20:03:25,848 DEBUG [RS:2;jenkins-hbase4:33091] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 20:03:25,848 INFO [RS:2;jenkins-hbase4:33091] regionserver.LeaseManager(133): Closed leases 2023-09-28 20:03:25,848 INFO [RS:2;jenkins-hbase4:33091] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-28 20:03:25,849 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-28 20:03:25,850 INFO [RS:2;jenkins-hbase4:33091] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33091 2023-09-28 20:03:25,851 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:03:25,851 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-28 20:03:25,851 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33091,1695931262281 2023-09-28 20:03:25,852 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33091,1695931262281] 2023-09-28 20:03:25,852 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33091,1695931262281; numProcessing=2 2023-09-28 20:03:25,853 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33091,1695931262281 already deleted, retry=false 2023-09-28 20:03:25,853 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,33091,1695931262281 expired; onlineServers=1 2023-09-28 20:03:25,942 DEBUG [RS:0;jenkins-hbase4:46795] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/oldWALs 2023-09-28 20:03:25,943 INFO [RS:0;jenkins-hbase4:46795] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46795%2C1695931262192:(num 1695931263957) 2023-09-28 20:03:25,943 DEBUG [RS:0;jenkins-hbase4:46795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 20:03:25,943 INFO [RS:0;jenkins-hbase4:46795] regionserver.LeaseManager(133): Closed leases 2023-09-28 20:03:25,943 INFO [RS:0;jenkins-hbase4:46795] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-28 20:03:25,943 INFO [RS:0;jenkins-hbase4:46795] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-28 20:03:25,943 INFO [RS:0;jenkins-hbase4:46795] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-28 20:03:25,943 INFO [RS:0;jenkins-hbase4:46795] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-28 20:03:25,943 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-28 20:03:25,944 INFO [RS:0;jenkins-hbase4:46795] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46795 2023-09-28 20:03:25,952 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46795,1695931262192 2023-09-28 20:03:25,952 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-28 20:03:25,952 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-28 20:03:25,952 INFO [RS:2;jenkins-hbase4:33091] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,33091,1695931262281; zookeeper connection closed. 2023-09-28 20:03:25,952 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:33091-0x100f42093bb0003, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-28 20:03:25,952 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4e0aec45] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4e0aec45 2023-09-28 20:03:25,953 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46795,1695931262192] 2023-09-28 20:03:25,953 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46795,1695931262192; numProcessing=3 2023-09-28 20:03:25,954 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46795,1695931262192 already deleted, retry=false 2023-09-28 20:03:25,954 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46795,1695931262192 expired; onlineServers=0 2023-09-28 20:03:25,954 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,35173,1695931260872' ***** 2023-09-28 20:03:25,954 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-09-28 20:03:25,954 DEBUG [M:0;jenkins-hbase4:35173] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1809d38b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-28 20:03:25,954 INFO [M:0;jenkins-hbase4:35173] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,35173,1695931260872 2023-09-28 20:03:25,954 INFO [M:0;jenkins-hbase4:35173] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,35173,1695931260872; all regions closed. 2023-09-28 20:03:25,954 DEBUG [M:0;jenkins-hbase4:35173] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 20:03:25,954 DEBUG [M:0;jenkins-hbase4:35173] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-09-28 20:03:25,955 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-09-28 20:03:25,955 DEBUG [M:0;jenkins-hbase4:35173] cleaner.HFileCleaner(317): Stopping file delete threads 2023-09-28 20:03:25,955 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695931263584] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695931263584,5,FailOnTimeoutGroup] 2023-09-28 20:03:25,955 INFO [M:0;jenkins-hbase4:35173] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-09-28 20:03:25,955 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695931263585] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695931263585,5,FailOnTimeoutGroup] 2023-09-28 20:03:25,955 INFO [M:0;jenkins-hbase4:35173] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-09-28 20:03:25,955 INFO [M:0;jenkins-hbase4:35173] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-09-28 20:03:25,955 DEBUG [M:0;jenkins-hbase4:35173] master.HMaster(1512): Stopping service threads 2023-09-28 20:03:25,955 INFO [M:0;jenkins-hbase4:35173] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-09-28 20:03:25,955 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-09-28 20:03:25,955 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-28 20:03:25,955 ERROR [M:0;jenkins-hbase4:35173] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-13,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-09-28 20:03:25,956 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-28 20:03:25,956 INFO [M:0;jenkins-hbase4:35173] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-09-28 20:03:25,956 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-09-28 20:03:25,957 DEBUG [M:0;jenkins-hbase4:35173] zookeeper.ZKUtil(398): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-09-28 20:03:25,957 WARN [M:0;jenkins-hbase4:35173] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-09-28 20:03:25,957 INFO [M:0;jenkins-hbase4:35173] assignment.AssignmentManager(315): Stopping assignment manager 2023-09-28 20:03:25,957 INFO [M:0;jenkins-hbase4:35173] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-09-28 20:03:25,958 DEBUG [M:0;jenkins-hbase4:35173] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-28 20:03:25,958 INFO [M:0;jenkins-hbase4:35173] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-28 20:03:25,958 DEBUG [M:0;jenkins-hbase4:35173] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-28 20:03:25,958 DEBUG [M:0;jenkins-hbase4:35173] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-28 20:03:25,958 DEBUG [M:0;jenkins-hbase4:35173] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-28 20:03:25,958 INFO [M:0;jenkins-hbase4:35173] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.63 KB heapSize=451.82 KB 2023-09-28 20:03:25,972 INFO [M:0;jenkins-hbase4:35173] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.63 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/d18fc022b9224352bfb9d90b17528fc3 2023-09-28 20:03:25,976 INFO [M:0;jenkins-hbase4:35173] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d18fc022b9224352bfb9d90b17528fc3 2023-09-28 20:03:25,977 DEBUG [M:0;jenkins-hbase4:35173] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/d18fc022b9224352bfb9d90b17528fc3 as hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/d18fc022b9224352bfb9d90b17528fc3 2023-09-28 20:03:25,981 INFO [M:0;jenkins-hbase4:35173] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d18fc022b9224352bfb9d90b17528fc3 2023-09-28 20:03:25,982 INFO [M:0;jenkins-hbase4:35173] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/d18fc022b9224352bfb9d90b17528fc3, entries=119, sequenceid=899, filesize=28.6 K 2023-09-28 20:03:25,983 INFO [M:0;jenkins-hbase4:35173] regionserver.HRegion(2948): Finished flush of dataSize ~375.63 KB/384649, heapSize ~451.80 KB/462648, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 24ms, sequenceid=899, compaction requested=false 2023-09-28 20:03:25,984 INFO [M:0;jenkins-hbase4:35173] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-28 20:03:25,984 DEBUG [M:0;jenkins-hbase4:35173] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-28 20:03:25,989 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/2e053b03-f1f4-0be5-c9db-3808926dcdff/MasterData/WALs/jenkins-hbase4.apache.org,35173,1695931260872/jenkins-hbase4.apache.org%2C35173%2C1695931260872.1695931262813 not finished, retry = 0 2023-09-28 20:03:26,053 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-28 20:03:26,053 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): regionserver:46795-0x100f42093bb0001, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-28 20:03:26,053 INFO [RS:0;jenkins-hbase4:46795] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,46795,1695931262192; zookeeper connection closed. 2023-09-28 20:03:26,053 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@22f94e4e] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@22f94e4e 2023-09-28 20:03:26,054 INFO [Listener at jenkins-hbase4.apache.org/41509] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-09-28 20:03:26,090 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-28 20:03:26,090 INFO [M:0;jenkins-hbase4:35173] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-09-28 20:03:26,091 INFO [M:0;jenkins-hbase4:35173] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35173 2023-09-28 20:03:26,094 DEBUG [M:0;jenkins-hbase4:35173] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,35173,1695931260872 already deleted, retry=false 2023-09-28 20:03:26,195 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-28 20:03:26,195 DEBUG [Listener at localhost/38989-EventThread] zookeeper.ZKWatcher(600): master:35173-0x100f42093bb0000, quorum=127.0.0.1:50329, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-28 20:03:26,195 INFO [M:0;jenkins-hbase4:35173] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,35173,1695931260872; zookeeper connection closed. 2023-09-28 20:03:26,197 WARN [Listener at jenkins-hbase4.apache.org/41509] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-28 20:03:26,201 INFO [Listener at jenkins-hbase4.apache.org/41509] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-28 20:03:26,305 WARN [BP-630755636-172.31.14.131-1695931257066 heartbeating to localhost/127.0.0.1:43143] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-28 20:03:26,305 WARN [BP-630755636-172.31.14.131-1695931257066 heartbeating to localhost/127.0.0.1:43143] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-630755636-172.31.14.131-1695931257066 (Datanode Uuid fb49aab3-6eb6-447b-acbd-f5bf34dbadf1) service to localhost/127.0.0.1:43143 2023-09-28 20:03:26,307 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/cluster_5fb315ef-67a6-d9cd-3b9f-c66cc0d16763/dfs/data/data5/current/BP-630755636-172.31.14.131-1695931257066] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-28 20:03:26,307 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/cluster_5fb315ef-67a6-d9cd-3b9f-c66cc0d16763/dfs/data/data6/current/BP-630755636-172.31.14.131-1695931257066] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-28 20:03:26,308 WARN [Listener at jenkins-hbase4.apache.org/41509] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-28 20:03:26,311 INFO [Listener at jenkins-hbase4.apache.org/41509] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-28 20:03:26,414 WARN [BP-630755636-172.31.14.131-1695931257066 heartbeating to localhost/127.0.0.1:43143] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-28 20:03:26,414 WARN [BP-630755636-172.31.14.131-1695931257066 heartbeating to localhost/127.0.0.1:43143] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-630755636-172.31.14.131-1695931257066 (Datanode Uuid 3437b551-e86c-45cd-bc77-d2833165be93) service to localhost/127.0.0.1:43143 2023-09-28 20:03:26,415 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/cluster_5fb315ef-67a6-d9cd-3b9f-c66cc0d16763/dfs/data/data3/current/BP-630755636-172.31.14.131-1695931257066] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-28 20:03:26,415 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/cluster_5fb315ef-67a6-d9cd-3b9f-c66cc0d16763/dfs/data/data4/current/BP-630755636-172.31.14.131-1695931257066] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-28 20:03:26,416 WARN [Listener at jenkins-hbase4.apache.org/41509] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-28 20:03:26,418 INFO [Listener at jenkins-hbase4.apache.org/41509] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-28 20:03:26,521 WARN [BP-630755636-172.31.14.131-1695931257066 heartbeating to localhost/127.0.0.1:43143] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-28 20:03:26,521 WARN [BP-630755636-172.31.14.131-1695931257066 heartbeating to localhost/127.0.0.1:43143] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-630755636-172.31.14.131-1695931257066 (Datanode Uuid fa9e69d3-666e-49d5-b2b3-2fea61b7694c) service to localhost/127.0.0.1:43143 2023-09-28 20:03:26,521 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/cluster_5fb315ef-67a6-d9cd-3b9f-c66cc0d16763/dfs/data/data1/current/BP-630755636-172.31.14.131-1695931257066] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-28 20:03:26,522 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6ae4a40-21f9-3d2a-390b-a0b61ab7c3b7/cluster_5fb315ef-67a6-d9cd-3b9f-c66cc0d16763/dfs/data/data2/current/BP-630755636-172.31.14.131-1695931257066] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-28 20:03:26,544 INFO [Listener at jenkins-hbase4.apache.org/41509] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-28 20:03:26,670 INFO [Listener at jenkins-hbase4.apache.org/41509] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-09-28 20:03:26,755 INFO [Listener at jenkins-hbase4.apache.org/41509] hbase.HBaseTestingUtility(1293): Minicluster is down